Skip to main content

Scrape and summarize posts of a news site without RSS feed using AI and save them to a NocoDB

Workflow preview

Workflow preview
100%
Scrape and summarize posts of a news site without RSS feed using AI and save them to a NocoDB preview
Open on n8n.io

Important notice

This workflow is provided as-is. Please review and test before using in production.

1. Workflow Overview

The News Site from Colt, a telecom company, does not offer an RSS feed, therefore web scraping is the choice to extract and process the news. The goal i...

Best for

  • Market Research automation workflows
  • AI Summarization automation workflows
  • advanced n8n builders looking for reusable templates

Tools used

n8n-nodes-base.html, n8n-nodes-base.openai, n8n-nodes-base.set, n8n-nodes-base.merge, n8n-nodes-base.code, n8n-nodes-base.httprequest, n8n-nodes-base.stickynote, n8n-nodes-base.scheduletrigger

Source and attribution

This workflow is cataloged by N8N Workflows and links back to its original n8n.io source page by Askan.

Original n8n.io source

1.1 Workflow description

Title
Scrape and summarize posts of a news site without RSS feed using AI and save them to a NocoDB
Workflow name
Scrape and summarize posts of a news site without RSS feed using AI and save them to a NocoDB

The News Site from Colt, a telecom company, does not offer an RSS feed, therefore web scraping is the choice to extract and process the news.

The goal is to get only the newest posts, a summary of each post and their respective (technical) keywords.

Note that the news site offers the links to each news post, but not the individual news. We collect first the links and dates of each post before extracting the newest ones.

The result is sent to a SQL database, in this case a NocoDB database.

This process happens each week thru a cron job.

Requirements:

  • Basic understanding of CSS selectors and how to get them via browser (usually: right click → inspect)
  • ChatGPT API account - normal account is not sufficient
  • A NocoDB database - of course you may choose any type of output target

Assumptions:

  • CSS selectors work on the news site
  • The post has a date with own CSS selector - meaning date is not part of the news content

"Warnings"

  • Not every site likes to be scraped, especially not in high frequency
  • Each website is structured in different ways, the workflow may then need several adaptations.

1.2 Logical Blocks

This catalog entry is organized from the workflow JSON. The node-level section below shows the executable blocks available for review before importing the template.

2. Block-by-Block Analysis

Block 1 - Extract the HTML with the right css class

Type / Role
n8n-nodes-base.html - html
Config choices
Version 1

Block 2 - Summary

Type / Role
n8n-nodes-base.openAi - openAi
Config choices
Version 1

Block 3 - Keywords

Type / Role
n8n-nodes-base.openAi - openAi
Config choices
Version 1

Block 4 - Rename keywords

Type / Role
n8n-nodes-base.set - set
Config choices
Version 3.1

Block 5 - Rename Summary

Type / Role
n8n-nodes-base.set - set
Config choices
Version 3.1

Block 6 - Merge

Type / Role
n8n-nodes-base.merge - merge
Config choices
Version 2.1

Block 7 - Extract date

Type / Role
n8n-nodes-base.html - html
Config choices
Version 1

Block 8 - Select posts of last 7 days

Type / Role
n8n-nodes-base.code - code
Config choices
Version 2

Block 9 - Merge date & links

Type / Role
n8n-nodes-base.merge - merge
Config choices
Version 2.1

Block 10 - HTTP Request1

Type / Role
n8n-nodes-base.httpRequest - httpRequest
Config choices
Version 4.1

Block 11 - Merge Content with Date & Link

Type / Role
n8n-nodes-base.merge - merge
Config choices
Version 2.1

Block 12 - Extract individual posts

Type / Role
n8n-nodes-base.html - html
Config choices
Version 1

Block 13 - Sticky Note

Type / Role
n8n-nodes-base.stickyNote - stickyNote
Config choices
Version 1

Block 14 - Merge ChatGPT output with Date & Link

Type / Role
n8n-nodes-base.merge - merge
Config choices
Version 2.1

Block 15 - Sticky Note1

Type / Role
n8n-nodes-base.stickyNote - stickyNote
Config choices
Version 1

Block 16 - Sticky Note2

Type / Role
n8n-nodes-base.stickyNote - stickyNote
Config choices
Version 1

Block 17 - Sticky Note3

Type / Role
n8n-nodes-base.stickyNote - stickyNote
Config choices
Version 1

Block 18 - Sticky Note4

Type / Role
n8n-nodes-base.stickyNote - stickyNote
Config choices
Version 1

Block 19 - Sticky Note5

Type / Role
n8n-nodes-base.stickyNote - stickyNote
Config choices
Version 1

Block 20 - Sticky Note6

Type / Role
n8n-nodes-base.stickyNote - stickyNote
Config choices
Version 1

Block 21 - Sticky Note7

Type / Role
n8n-nodes-base.stickyNote - stickyNote
Config choices
Version 1

Block 22 - Retrieve the web page for further processsing

Type / Role
n8n-nodes-base.httpRequest - httpRequest
Config choices
Version 4.1

Block 23 - Sticky Note9

Type / Role
n8n-nodes-base.stickyNote - stickyNote
Config choices
Version 1

Block 24 - Sticky Note10

Type / Role
n8n-nodes-base.stickyNote - stickyNote
Config choices
Version 1

Showing the first 24 of 36 workflow blocks. Download the JSON for the full node graph.

3. Summary Table

Workflow Scrape and summarize posts of a news site without RSS feed using AI and save them to a NocoDB
Complexity advanced
Nodes 36
Categories Market Research, AI Summarization
Author Askan
Published 17 Mar 2024

4. Reproducing the Workflow from Scratch

  1. 1. Download the workflow JSON

    Use the JSON export at /data/workflows/2180/2180.json as the source template for this automation.

  2. 2. Import the template into n8n

    Open n8n, import the downloaded JSON, and review each node before activating the workflow.

  3. 3. Configure credentials and variables

    Replace placeholder credentials, API keys, webhook URLs, account IDs, and environment-specific values with your own settings.

  4. 4. Test with sample data

    Run the workflow manually or in a staging workspace, inspect node output, and confirm downstream systems receive the expected data.

  5. 5. Activate and monitor

    Enable the workflow only after testing, then monitor executions, errors, and rate limits during the first production runs.

5. General Notes & Resources

Review imported nodes carefully before activation. This catalog entry is intended to help you inspect the workflow structure, understand required services, and find related templates faster.

Node names, credentials, schedules, webhook paths, and external service limits may need adjustment for your workspace.

Frequently asked questions

What does Scrape and summarize posts of a news site without RSS feed using AI and save them to a NocoDB do?

The News Site from Colt, a telecom company, does not offer an RSS feed, therefore web scraping is the choice to extract and process the news. The goal i...

What do I need before importing this workflow?

Review the workflow JSON, configure any required credentials in n8n, and test the automation in a safe workspace before using it in production.

Can I customize this workflow?

Yes. Use the block-by-block analysis and the downloadable JSON to inspect each node, then adjust credentials, prompts, schedules, filters, or destinations for your Market Research, AI Summarization use case.