Need help for Fine Tuning

I want to fine tuned model with my own dataset so that later when user ask question so he/she able to get answer from provided document. So I am struggling with training model as I tried different models with full and lora fine tuning but accuracy of answer was not good. And there is problem to create jsonl file of Question- Answer pair which is used to fine tuned model.