We’re seeking an experienced developer to help enhance our AI-powered content generation system by integrating crawled website URLs as citations. The ideal candidate will have expertise in working with large language models (LLMs), web crawling data, and natural language processing.

Key Responsibilities:
• Develop a system to match relevant crawled URLs to specific sections of LLM-generated text
• Implement citation insertion logic to seamlessly add URL references to AI outputs
• Optimize citation matching for accuracy and relevance
• Ensure proper formatting and styling of citations within generated content
• Create a flexible and scalable solution that can handle large volumes of data

Requirements:
• 3+ years of experience in software development, preferably with AI/ML systems
• Strong programming skills in Python, JavaScript, or similar languages
• Familiarity with LLMs like GPT-3/4 and natural language processing techniques
• Experience working with web crawl data and URL processing
• Knowledge of information retrieval and text matching algorithms
• Excellent problem-solving and analytical skills
Nice to Have:
• Prior work on citation systems or academic writing tools
• Experience with vector databases or semantic search

Please include in your proposal:
Your relevant experience with LLMs and web data integration
Your approach to matching crawled URLs to generated text

Hourly Range: $12.00-$25.00

Posted On: June 27, 2024 05:24 UTC
Category: Scripting & Automation
Skills:Python, API, Data Scraping

Country: Canada

click to apply