0·
2 months agoUmmm… did you try /set parameter num_ctx # and /set parameter num_predict #? Are you using a model that actually supports the context length that you desire…?
- 0 Posts
- 2 Comments
Joined 10 months ago
Cake day: June 13th, 2024
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
Dunno why this is downvoted because RAG is the correct answer. Fine tuning/training is not the tool for this job. RAG is.