Build a LinkedIn job intelligence pipeline with Apify and Google Sheets

Name: Build a LinkedIn job intelligence pipeline with Apify and Google Sheets
Availability: InStock
Author: Ahmed Salama

Build a LinkedIn job intelligence pipeline with Apify and Google Sheets preview

Open on n8n.io

$20/month : Unlimited workflows

2500 executions/month

Try free

THE #1 IN WEB SCRAPING

Scrape any website without limits

Try free

HOSTINGER

Early Deal
DISCOUNT 20%

Self-hosted n8n

Unlimited workflows - from $4.99/mo

Try free

#1 hub for scraping, AI & automation

6000+ actors - $5 credits/mo

Try free

Overview

LinkedIn Job Intelligence Automation (n8n + Apify)

This workflow creates a fully automated LinkedIn job intelligence system that continuously scrapes job postings, enriches them with time-based insights, removes duplicates, and stores them in a structured Google Sheet for analysis, outreach, or decision-making.

Built for founders, recruiters, sales teams, and consultants who want real-time hiring signals instead of static lead databases, this workflow turns job postings into actionable business intelligence.

Benefits

Real-Time Hiring Signals Detect company growth, hiring urgency, and budget intent before announcements.
Automated Lead Discovery Identify companies actively hiring relevant roles, indicating readiness to buy services or tools.
Zero Manual Work Fully automated scraping, enrichment, and storage.
De-duplicated Data Prevents repeated job entries using job ID matching logic.
Time-Based Insight Automatically calculates how many days ago a job was posted.
Flexible Output Stored in Google Sheets for BI tools, CRMs, AI agents, or manual review.

How It Works

LinkedIn Job Scraping (Apify Actor)

Uses Apify LinkedIn Jobs Scraper actor
Accepts up to 10 LinkedIn job search URLs
Extracts up to 100 jobs per run (configurable)
Pulls structured data including:
Job ID
Job title
Company name
Location
Posting date
Job URL

Data Enrichment & Transformation

Standardizes all job fields using a Set node
Computes “How many days since posted” using runtime date comparison
Prepares clean, analysis-ready records

Batch Processing Control

Uses Split In Batches to:
Avoid API throttling
Maintain stable execution
Scale safely for larger job volumes

De-Duplication Logic

Checks Google Sheets for existing job IDs
Only inserts new jobs
Ensures clean historical datasets with no duplicates

Persistent Storage (Google Sheets)

Appends validated job records to a centralized sheet
Acts as:
Lead database
Market intelligence log
BI or AI agent data source

Required Setup Configuration

Apify Integration

Connect Apify OAuth credentials
Use the LinkedIn Jobs Scraper actor
Customize:
Keywords
Location
Job count
Company scraping toggle

Google Sheets Integration

Create a target Google Sheet
Columns required:
Job ID
Job URL
Title
Company Name
Location
Posted Date
Days Since Posted
Enable OAuth access for n8n

n8n Configuration

Manual trigger (can be replaced with Cron for automation)
Batch size control for scaling
Error-safe execution with continuation enabled

Business Use Cases

Sales & Lead Generation Teams

Target companies actively hiring roles related to your offer
Prioritize outreach based on hiring urgency

Founders & CEOs

Monitor competitor hiring velocity
Identify market expansion signals early

Recruiters & Staffing Agencies

Build live job pipelines without manual LinkedIn searches
Reduce sourcing time dramatically

Consultants & Agencies

Detect companies entering problem-aware or scaling phases
Align service offers with real hiring pain points

Market & VC Analysts

Use hiring data as a leading indicator for growth or decline

Revenue Potential

This workflow enables multiple monetization paths:

Lead Intelligence as a Service Sell curated hiring signals to sales teams or agencies
Recruitment Automation Reduce recruiter sourcing costs by 70–90%
Consulting Insights Bundle hiring data into strategy or growth audits
Outbound Acceleration Increase reply rates by targeting active hiring companies

Difficulty Level

Beginner to Intermediate

Estimated Build Time

30–45 minutes

Monthly Operating Cost

Apify usage (based on volume)
Google Sheets: Free
n8n: Self-hosted or cloud plan

Typical range: $10–25/month

Why This Workflow Works

Hiring data reflects real budget allocation
Job posts act as pre-revenue intent signals
Time-based metrics enable prioritization
De-duplication ensures long-term data quality
Simple storage makes it easy to extend with:
CRMs
AI agents
BI dashboards
Email or LinkedIn outreach automations

Advanced Extensions

Auto-enrich companies with LinkedIn company data
Push qualified jobs into CRM as leads
Trigger outbound emails based on posting age
Add AI classification for role relevance
Connect to Slack or email alerts for new jobs

Ahmed Salama

6 workflows

Complexity

intermediate

Published 20 Jan 2026

Likes 0

View on n8n.io Download Workflow

Install path: /data/workflows/12838/12838.json

Share Your Workflow

Have a useful automation to share? Publish it and help the community.

Submit Your Template How to Submit

Related Workflows

Compare physical vs digital 24K gold costs and returns with GoldAPI, IBJA, Groq and Google Sheets

# Gold Investment Intelligence: Physical vs. Digital 24K Cost & Return Analysis This high-performance n8n workflow automates the complex task of comparing gold investment types in the Indian market. By pulling live data from the **GoldAPI** (Digital) and the **IBJA** (Physical benchmark), it calculates the "Landed Cost" including GST and making charges to provide a data-driven "Buy/Wait" verdict powered by a **Groq-hosted LLM**. Stop manually calculating gold spreads across different platforms. This workflow fetches real-time 24K gold rates, applies localized taxes (3% GST) and industry-standard fees (3-8%), analyzes global market sentiment via Yahoo Finance RSS and logs a professional investment report to Google Sheets. It transforms raw data into an actionable "Efficiency Score" using AI. ### Quick Implementation Steps: 1. **Import** the JSON file into your n8n canvas. 2. **Get API Key:** Sign up at GoldAPI.io and paste your token into the "Get Digital Price" header. 3. **Connect AI:** Add your Groq API credentials to the "Groq Chat Model" node. 4. **Prepare Sheet:** Create a Google Sheet with these headers: `Date`, `Digital_Price`, `Physical_Price`, `Arbitrage`, `Sentiment` and `Efficiency_Score`. 5. **Authorize:** Link your Google account in the "Add Report" node and select your spreadsheet. ## What It Does This workflow acts as a 24/7 Quantitative Financial Analyst specialized in the gold market. It eliminates the "hidden cost" surprise by calculating the absolute final price an investor pays out-of-pocket for 1 gram of 24K gold. It doesn't just look at the ticker price; it factors in the 3% GST applicable in India, platform spreads for digital gold apps and making charges for physical coins/bars. Beyond raw arithmetic, the workflow contextually understands the global landscape. By scraping the latest commodity headlines from Yahoo Finance, the integrated AI Agent determines if the current market vibe is "Greedy," "Neutral," or "Fearful." It then synthesizes the price gap and the news into a single "Efficiency Score" (1-100), telling you exactly how favorable the buying conditions are today. Finally, it maintains a permanent investment ledger. Every execution logs the data into a Google Sheet and formats a clean report ready to be sent to messaging apps, ensuring you never miss a buying opportunity when the "Arbitrage" (the price difference) favors one medium over the other. ## Who’s It For * **Retail Investors:** Who want to know if it's cheaper to buy gold on a digital app or from a local jeweler today. * **Financial Advisors:** Who need automated, data-backed daily gold market sentiment reports for their clients. * **Gold Enthusiasts:** Tracking the price variance (Arbitrage) between digital and physical assets to optimize their portfolio. * **FinTech Developers:** Looking for a professional blueprint on how to combine Web Scraping, Financial APIs and LLMs in n8n. ## Requirements * [n8n Instance (supporting LangChain nodes)](https://n8n.partnerlinks.io/om1efg2qgvwi). * **GoldAPI Token:** Free or Paid API key from GoldAPI.io. * **Groq API Key:** To power the AI analysis (supports Llama 3 or Mixtral models). * **Google Account:** For logging data into Google Sheets. * **Internet Access:** To scrape the IBJA (India Bullion and Jewellers Association) website. ## How It Works & Set Up ### Step 1: Data Collection The workflow starts with a **Manual Trigger** (can be changed to a **Schedule Trigger** for daily runs). It fetches the live 1-gram digital gold price in INR via an HTTP Request to GoldAPI. Simultaneously, it scrapes the official IBJA website to extract the physical benchmark rate using the CSS selector `#GoldRatesCompare999`. ### Step 2: The Math (Landed Costs) The **Comparator** node uses JavaScript to apply real-world fees: * **Digital:** Adds 3% GST and a 3% platform spread. * **Physical:** Adds 3% GST and 8% making charges (standard for coins). * It then determines which is cheaper and calculates the exact difference. ### Step 3: Market Context The workflow pulls the top 3 most recent gold market headlines from Yahoo Finance. These are bundled together so the AI can read them in one go. ### Step 4: AI Analysis & Output The **AI Agent** takes the math and the news headlines. It outputs a structured JSON verdict containing: * **Arbitrage Check:** A one-sentence summary of the best deal. * **Sentiment:** A label (Greedy/Neutral/Fearful). * **Efficiency Score:** A rating out of 100. ### Step 5: Logging The data is formatted into a readable message and appended as a new row in your designated Google Sheet. ## How To Customize Nodes * **Adjust Fees:** If your local jeweler charges 10% instead of 8%, simply open the **Comparator** node and change the `1.08` value in the code. * **Change AI Model:** In the **Groq Chat Model** node, you can switch between different models (e.g., Llama-3-70b vs 8b) depending on your speed and accuracy needs. * **Update Selectors:** If the IBJA website updates its design, you can update the CSS Selector in the **Extract Physical Price** node to point to the new data location. ## Add-ons * **WhatsApp/Telegram Notifications:** Add a node after "Message Format" to send the daily report directly to your phone. * **Email Summary:** Use the Gmail or Outlook node to send a weekly summary of the best buying days to your inbox. * **Price Drop Alert:** Add an **IF Node** to only trigger the workflow if the gold price drops by more than 2% in a single day. ## Use Case Examples * **Automated Savings:** Set the workflow to run every morning at 10 AM to decide where to put your daily savings. * **Jewelry Business Tool:** Use the data to show customers that your physical prices are competitive compared to digital market apps. * **Market Research:** Use the Google Sheet history to track how "Sentiment" affects the price of gold over several months. * **Arbitrage Trading:** Identify moments when digital gold is significantly undervalued compared to physical benchmarks. * **Wealth Management:** Proactively notify clients when the "Efficiency Score" hits 90+, indicating a prime buying opportunity. ## Troubleshooting Guide | Issue | Possible Cause | Solution | | :--- | :--- | :--- | | **Digital Price = 0 or Error** | API Key is missing or expired. | Check the "Get Digital Price" node; ensure the token is in the headers. | | **Physical Price Extraction Fails** | Website structure changed. | Verify the URL and the CSS selector `#GoldRatesCompare999` on IBJA. | | **AI Agent gives generic response** | Prompt is too vague or news is missing. | Ensure the "Data Array" node is successfully bundling headlines. | | **Google Sheets won't append** | Missing columns or incorrect ID. | Ensure headers (`Date`, `Sentiment`, etc.) match exactly in your sheet. | ## Need Help? Need assistance setting up your GoldAPI credentials, customizing the making charges or adding custom notifications to this workflow? We can help you build and scale your automation ideas. **[Contact WeblineIndia](https://www.weblineindia.com/contact-us.html)** to help you customize this workflow or build similar AI-powered financial tools for your business.

View

Track Idealista market stats weekly and email Google Sheets reports with Idealista Scraper

![Screenshot 20260413 at 15.59.08.png](fileId:5459) ## Who is this for Real estate investors comparing markets across cities, agencies generating market reports for clients, property consultants doing due diligence, or analysts tracking price trends in Southern European property markets. ## What this workflow does Every Monday at 8am, this workflow scrapes property listings from multiple Idealista markets, calculates key statistics, builds an HTML comparison report, emails it to you, and logs data to Google Sheets for long-term trend tracking. 1. The Schedule Trigger fires every Monday at 8am 2. Two Idealista Scraper nodes fetch Madrid and Barcelona listings in parallel via API-based extraction (never breaks) 3. Code nodes calculate per-market statistics: average/median price, price range, price per m2, average size, average rooms 4. The Merge node combines both market analyses into one dataset 5. A Code node builds a professionally formatted HTML comparison table 6. The report is emailed via Gmail and weekly stats are logged to Google Sheets Idealista has no official API and no built-in market analytics. This workflow turns raw listing data into actionable market intelligence, automatically, every week. ## Setup 1. Install **n8n-nodes-idealista-scraper** via Settings > Community Nodes (self-hosted n8n only) 2. Add your **Apify API** credential ([get token](https://console.apify.com/account/integrations)) 3. Add your **Gmail** credential (OAuth2) 4. Create a Google Sheet with a tab named "MarketHistory" 5. Update the email recipient in the Gmail node 6. Activate the workflow ## Requirements - Self-hosted n8n instance (community node not available on n8n Cloud) - Apify account with API token - Gmail account with OAuth2 credential configured in n8n - Google Sheets account with OAuth2 credential configured in n8n ## How to customize this workflow - Add more cities by duplicating a Scraper + Analysis pair (Valencia, Rome, Lisbon, Milan) - Switch `operation` from `sale` to `rent` to analyze rental markets - Add price filters to focus on specific segments (luxury above 1M EUR, budget below 200K EUR) - Calculate rental yield by scraping both sale and rent for the same area - Add an IF node after analysis to send alerts when average price drops below a threshold - Cost: ~$0.50/week (2 markets x 3 pages x ~40 properties each)

View

Generate weekly Reddit startup opportunity reports with Groq AI

### This n8n template automatically scans 10 subreddits every Monday, filters ~1000 posts for genuine frustration signals, and delivers a structured startup opportunity report to your inbox — powered by Groq AI. Perfect for indie hackers, product builders, and founders who want to stay on top of what people are actually begging someone to build — without spending hours manually browsing Reddit. **Good to know** - Uses Reddit's public JSON API — no Reddit account or API key required - Groq's free tier is generous enough to run this weekly at zero cost - Each run analyzes up to 1000 posts and completes in under 60 seconds ## How it works - A Schedule Trigger fires every Monday at 8AM to kick off the workflow - A Code node defines 10 target subreddits (entrepreneur, SaaS, freelance, startups, and more) - An HTTP Request node fetches the 100 newest posts from each subreddit using Reddit's public JSON endpoint - A Code node filters all posts against 27 frustration-signal keywords like "why doesn't X exist", "sick of manually", "wish there was a tool for this" - An Aggregate node merges all matched posts from all 10 subreddits into a single dataset - A Code node builds a structured AI prompt embedding all posts with specific instructions for analysis - An HTTP Request node sends the dataset to Groq's API (llama-3.3-70b-versatile) for deep analysis - A Code node wraps the AI output in a clean HTML email template - A Gmail node delivers the weekly report directly to your inbox ## How to use - Import the workflow and connect your Groq API key as an HTTP Header Auth credential - Connect your Gmail account via OAuth2 - Change the recipient email in the Gmail node to your own address - Run manually first to verify the full flow end to end, then activate the schedule ## Requirements - Groq account for AI analysis (free at console.groq.com) - Gmail account for delivery via OAuth2 ## Customising this workflow - Edit the subreddit list in the Define Subreddits node to focus on your specific niche or industry - Add or remove keywords in the Filter Posts node to tune how sensitive the pain detection is - Swap the Gmail node for Slack, Telegram, or Outlook if you prefer a different delivery channel - Change the schedule from weekly to daily for higher-frequency monitoring - Replace Groq with OpenAI GPT-4o by swapping the HTTP Request URL and auth header — the prompt format is identical

View

Need Custom Automation?

Get help designing a custom n8n workflow that connects your stack and fits your process.

Build a LinkedIn job intelligence pipeline with Apify and Google Sheets

Workflow preview

Overview

Categories

LinkedIn Job Intelligence Automation (n8n + Apify)

Benefits

How It Works

LinkedIn Job Scraping (Apify Actor)

Data Enrichment & Transformation

Batch Processing Control

De-Duplication Logic

Persistent Storage (Google Sheets)

Required Setup Configuration

Apify Integration

Google Sheets Integration

n8n Configuration

Business Use Cases

Sales & Lead Generation Teams

Founders & CEOs

Recruiters & Staffing Agencies

Consultants & Agencies

Market & VC Analysts

Revenue Potential

Difficulty Level

Estimated Build Time

Monthly Operating Cost

Why This Workflow Works

Advanced Extensions