LORA

Making local llm based AI Assistants work in consumer grade devices

I thought fine tuning of models is to inject app specific data in to the model, but i found out recently that this could be used to make a model work well in consumer grade devices by injecting information to make the model more aware of app's system prompt specific expected outcomes.