job-flow

Flow

scrape offers from sources for job offers -> for each offer, ask llm whether it meets my expectations and skills -> if it does add it to database

scrape -> db
db -> llm -> db

Scrape

• https://jina.ai/reader - cant read behind login

linkedin

• https://github.com/joeyism/linkedin_scraper?tab=readme-ov-file#job-scraping
  • lot of stars
  • docs

LLM

i want json response for sure, so i want to use openrouter.com

Model

• gemini?

Prompting

langchain etc?

• to be established

DB

• postgresql => seperate container

table for:

• rejected offers
  • so i dont burn tokens @ llm with the same offers every time
• interesting offers
  • schema

Containers

• db
  • table for all offers
  • table for relevant offers
• llm
  • api
  • prompts
• scraper
  • scrape linkedin