Back to projects

LLM · GenAI Jun 2024

AI Blog Generator (LLaMA 2)

Abstract.Turning a prompt into a full blog post with an LLM that runs entirely on-device.

Role
Developer
Period
Jun 2024
Context
Personal project
Team
Solo
Table 1Results.
Local Runs fully on-device

01How it works

  1. Input Prompt & parameters Topic, writing style and target word count.
  2. Step 02 LangChain prompt Build the prompt template and generation flow.
  3. Step 03 LLaMA 2 (local) CTransformers runs the model on-device.
  4. Output Generate & display The article appears in the Streamlit UI.
Fig. 1AI Blog Generator (LLaMA 2), step by step.

02What I built

  1. Ran LLaMA 2 fully on-device with CTransformers.
  2. Built the prompt template and generation flow with LangChain.
  3. Built an interactive Streamlit UI with topic, style and word-count controls.
The blog generator's Streamlit interface
Fig. 2The blog generator's Streamlit interface

03Technologies

  • Python
  • LLaMA 2
  • LangChain
  • CTransformers
  • Streamlit

On request

Request my resume

I share my resume on request. Tell me a little about yourself, and I'll email it to you once I've reviewed your request.

I am a…

Which document?

0 / 100 words

Your details are used only to handle this request and are never shared.