SALT-NLP/SWE-chat
Viewer • Updated • 11.9M • 7.75k • 125
Arjun Patel
arjunpatel
AI & ML interests
Learning transformers for fun!
Recent Activity
liked a dataset about 2 hours ago
SALT-NLP/SWE-chat liked a dataset about 2 hours ago
trace-commons/agent-traces liked a model 2 months ago
nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16Organizations
liked 2
datasets about 2 hours ago
liked a
model 2 months ago
upvoted a paper 4 months ago
liked a
model 4 months ago
liked 2
models 7 months ago
🚩 Report: Not working
🔥 1
3
#3 opened about 2 years ago
by 
omanball
Create config.json
3
#1 opened about 2 years ago
by 
ahsanjutt
liked 3
models over 2 years ago
reacted to harpreetsahota's post with ❤️ over 2 years ago
Post
google/gemma-7b-it is super good!
I wasn't convinced at first, but after vibe-checking it...I'm quite impressed.
I've got a notebook here, which is kind of a framework for vibe-checking LLMs.
In this notebook, I take Gemma for a spin on a variety of prompts:
• [nonsensical tokens]( harpreetsahota/diverse-token-sampler
• [conversation where I try to get some PII)( harpreetsahota/red-team-prompts-questions)
• [summarization ability]( lighteval/summarization)
• [instruction following]( harpreetsahota/Instruction-Following-Evaluation-for-Large-Language-Models
• [chain of thought reasoning]( ssbuild/alaca_chain-of-thought)
I then used LangChain evaluators (GPT-4 as judge), and track everything in LangSmith. I made public links to the traces where you can inspect the runs.
I hope you find this helpful, and I am certainly open to feedback, criticisms, or ways to improve.
Cheers:
You can find the notebook here: https://colab.research.google.com/drive/1RHzg0FD46kKbiGfTdZw9Fo-DqWzajuoi?usp=sharing
I wasn't convinced at first, but after vibe-checking it...I'm quite impressed.
I've got a notebook here, which is kind of a framework for vibe-checking LLMs.
In this notebook, I take Gemma for a spin on a variety of prompts:
• [nonsensical tokens]( harpreetsahota/diverse-token-sampler
• [conversation where I try to get some PII)( harpreetsahota/red-team-prompts-questions)
• [summarization ability]( lighteval/summarization)
• [instruction following]( harpreetsahota/Instruction-Following-Evaluation-for-Large-Language-Models
• [chain of thought reasoning]( ssbuild/alaca_chain-of-thought)
I then used LangChain evaluators (GPT-4 as judge), and track everything in LangSmith. I made public links to the traces where you can inspect the runs.
I hope you find this helpful, and I am certainly open to feedback, criticisms, or ways to improve.
Cheers:
You can find the notebook here: https://colab.research.google.com/drive/1RHzg0FD46kKbiGfTdZw9Fo-DqWzajuoi?usp=sharing
updated a
model over 2 years ago
liked 2
models over 2 years ago
liked a
model almost 3 years ago
updated a
model almost 3 years ago
liked 2
Spaces over 3 years ago