Cover Letter Generator using Large Language Models (LLM)

This project aims to Explore various open-source Large Language Models (LLMs) and compare them to OpenAI models.

• Open Source Models: I've been experimenting with quantized open source LLMs from Hugging Face, running them locally on CPUs. While processing speed is currently limited (aroung 5 minutes), it dramatically improves when deployed on a GPU server. This proves the potential of using these models in production for real-world applications! I have used CTransformer library for using these models.
  Model links:
  • https://huggingface.co/TheBloke/Marcoroni-7B-v3-GGUF
  • https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.2-GGUF
  • https://huggingface.co/TheBloke/LeoScorpius-7B-GGUF
• Open AI Models: Open AI models are the current state of the art models. Implemented GPT-4 Turbo, GPT-4, and GPT-3.5 using Langchain.

Test it right here!

Links

• hf.space
• github