#web-scraping

An Agentic RAG-powered chatbot delivering intelligent, fact-grounded and context-aware answers for the DIEM Department at the University of Salerno.

OpenAI compatible API on top of the free web clients

Agentic AI system that ingests PSX market data and financial news, resolves conflicting signals, and constructs a justified investment portfolio with simulated execution.

Hourly pipeline that discovers, fetches, and classifies engineering jobs from company ATS boards — publishes a curated index to builder-jobs.

Token-cheap web browsing for AI agents (Claude Code, Codex, Cursor): search, navigate and an agent mode that closes cookie banners and acts human. CLI, no MCP, multi-browser (Chrome/Edge/Opera).

Early-detection internship pipeline: polls ~290 ATS endpoints + community repos every 15 min, fit-ranks via Claude, alerts first.

End-to-end YouTube Channel Analytics Pipeline - YouTube API v3, NLP, TF-IDF Clustering, SQLite | MSc AI @ DBS

Autonomous Web Agent Toolkit 2026 - AI Browser Automation for Testing & Scraping

🌀 Wraith — the identity-borrowing stealth browser for autonomous agents (Camoufox stealth + WAAP clearing + MCP)

Give Claude Code live web access with the Scrapeless MCP server — 21 tools for search, scraping, screenshots, and cloud browser automation from one config file.

Serverless comics news backend on AWS. Ingests 11 RSS feeds via scheduled Lambda, scrapes full article HTML and uses OpenAI GPT-4 to rewrite content with an editorial voice. Node.js 24, Serverless Framework v4, DynamoDB with TTL, API Gateway.

Advanced n8n workflow automating web scraping (Firecrawl), AI-powered filtering (OpenAI), and news consolidation. Features a fault-tolerant architecture with report exports to Google Workspace.

Apify Actor workflows for AI visibility, review intelligence, and buyer-ready business reports.

Multi-cloud market intelligence on AWS / Azure / GCP - live GPU pricing tracker, 2016-2026 market history from SEC filings, SQL star schema, interactive dashboards

AI-powered Amazon Product Search Scraper built with n8n, Bright Data Web Scraper API, OpenAI GPT-4o Mini, and Google Sheets. Automatically scrapes Amazon search result pages, extracts structured product information using AI, and stores the results in Google Sheets.