Incrementors

Workflows

Workflows by Incrementors

Sort by:

Detect keyword cannibalization with GPT-4o and Google Search Console

**AI-Powered Keyword Cannibalization Detection Workflow** **Overview** This is an advanced n8n automation workflow designed to detect and analyze keyword cannibalization issues across multiple client websites using Google Search Console data and artificial intelligence. The system provides real-time monitoring and comprehensive reporting to help SEO professionals identify and resolve internal competition between pages ranking for the same keywords. **Core Components** **1. Automated Monitoring System** - **Real-time trigger:** Monitors Google Sheets for keyword changes every minute - **Multi-client support:** Handles up to 4 different client websites simultaneously - **Intelligent routing:** Automatically directs each client's data through dedicated processing paths **2. Data Collection & Processing** - **GSC Integration:** Fetches 30 days of search performance data from Google Search Console API - **Comprehensive metrics:** Collects keyword rankings, page URLs, positions, clicks, impressions, and CTR - **Data transformation:** Groups raw API responses by keywords for structured analysis - **Cross-referencing:** Matches target keywords from Google Sheets with actual GSC performance data **3. AI Analysis Engine** - **GPT-4o powered:** Uses advanced AI to analyze keyword competition patterns - **Risk categorization:** Automatically classifies cannibalization risk as: - **High Risk:** 5+ pages competing for the same keyword - **Moderate Risk:** 3+ pages ranking in top 10 positions - **Low Risk:** 2 pages with one clearly dominating - **No Risk:** Single page ranking for the keyword - **Intelligent reasoning:** Provides detailed explanations for each risk assessment **4. Comprehensive Reporting** - **Automated output:** Saves analysis results back to Google Sheets - **Detailed insights:** Includes risk levels, reasoning, observations, and actionable remediation steps - **Performance tracking:** Complete keyword performance metrics for client reporting - **Status tracking:** Identifies which keywords are ranking vs. missing from search results

Automate blog creation & publishing with Gemini, Ideogram AI and WordPress

## **Overview:** This n8n workflow automates the complete blog publishing process from topic research to WordPress publication. It researches topics, writes SEO-optimized content, generates images, publishes posts, and notifies teams—all automatically from Google Sheets input. ## **How It Works:** **Step 1: Client Management & Scheduling** - **Client Data Retrieval:** Scans master Google Sheet for clients with "Active" project status and "Automation" blog publishing setting - **Publishing Schedule Validation:** Checks if current day matches client's weekly frequency (Mon, Tue, Wed, Thu, Fri, Sat, Sun) or if set to "Daily" - **Content Source Access:** Connects to client-specific Google Sheet using stored document ID and sheet name **Step 2: Content Planning & Selection** - **Topic Filtering:** Retrieves rows where "Status for Approval" = "Approved" and "Live Link" = "Pending" - **Content Validation:** Ensures Focus Keyword field is populated before proceeding - **Single Topic Processing:** Selects first available topic to maintain quality and prevent API rate limits **Step 3: AI-Powered Research & Writing** - **Comprehensive Research:** Google Gemini analyzes search intent, competitor content, audience needs, trending subtopics, and LSI keywords - **Content Generation:** Creates 800-1000 word articles with natural keyword integration, internal linking, and conversational tone optimized for Indian investors - **Quality Assessment:** Evaluates content for human-like writing, conversational tone, readability, and engagement factors - **Content Optimization:** Automatically fixes grammar, punctuation, sentence flow, and readability issues while maintaining HTML structure **Step 4: Visual Content Creation** - **Image Prompt Generation:** OpenAI creates detailed prompts based on blog title and content for professional visuals - **Image Generation:** Ideogram AI produces 1248x832 resolution images with realistic styling and professional appearance - **Binary Processing:** Downloads and converts generated images to binary format for WordPress upload **Step 5: WordPress Publication** - **Media Upload:** Uploads generated image to WordPress media library with proper filename and headers - **Content Publishing:** Creates new WordPress post with title, optimized content, and embedded image - **Featured Image Assignment:** Sets uploaded image as post's featured thumbnail for proper display - **Category Assignment:** Automatically assigns posts to predefined category **Step 6: Tracking & Communication** - **Status Updates:** Updates Google Sheet with live blog URL in "Live Link" column using S.No. as identifier - **Team Notification:** Sends Discord message to designated channel with published blog link and review request - **Process Completion:** Triggers next iteration or workflow conclusion based on remaining topics ## **Setup Steps:** **Estimated Setup Time:** 45-60 minutes **Required API Credentials:** **1. Google Sheets API** - Service account with sheets access - OAuth2 credentials for client-specific sheets - Proper sharing permissions for all target sheets **2. Google Gemini API** - Active API key with sufficient quota - Access to Gemini Pro model for content generation - Rate limiting considerations for bulk processing **3. OpenAI API** - GPT-4 access for creative prompt generation - Sufficient token allocation for daily operations - Fallback handling for API unavailability **4. Ideogram AI API** - Premium account for quality image generation - API key with generation permissions - Understanding of rate limits and pricing **5. WordPress REST API** - Application passwords for each client site - Basic authentication setup with proper encoding - REST API enabled in WordPress settings - User permissions for post creation and media upload **6. Discord Bot API** - Bot token with message sending permissions - Channel ID for notifications - Guild access and proper bot roles ## **Master Sheet Configuration:** **Document Structure:** Create primary tracking sheet with columns - **Client Name:** Business identifier - **Project Status:** Active/Inactive/Paused - **Blog Publishing:** Automation/Manual/Disabled - **Website URL:** Full WordPress site URL with trailing slash - **Blog Posting Auth Code:** Base64 encoded username: password - **On Page Sheet:** Google Sheets document ID for content planning - **WeeklyFrequency:** Daily/Mon/Tue/Wed/Thu/Fri/Sat/Sun - **Discord Channel:** Channel ID for notifications ## **Content Planning Sheet Structure:** **Required Columns** (exact naming required): - **S.No.:** Unique identifier for tracking - **Focus Keyword:** Primary SEO keyword - **Content Topic** Article title/subject - **Target Page:** Internal linking target - **Words:** Target word count - **Brief URL:** Content brief reference - **Content URL:** Draft content location - **Status for Approval:** Pending/Approved/Rejected - **Live Link:** Published URL (auto-populated) ## **WordPress Configuration:** - **REST API Activation:** Ensure wp-json endpoint accessibility - **User Permissions:** Create dedicated user with Editor or Administrator role - **Application Passwords:** Generate secure passwords for API authentication - **Category Setup:** Create or identify category ID for automated posts - **Media Settings:** Configure upload permissions and file size limits - **Security:** Whitelist IP addresses if using security plugins ## **Discord Integration Setup:** - **Bot Creation:** Create application and bot in Discord Developer Portal - **Permissions:** Grant Send Messages, Embed Links, and Read Message History - **Channel Configuration:** Set up dedicated channel for blog notifications - **User Mentions:** Configure user ID for targeted notifications - **Message Templates:** Customize notification format and content ## **Workflow Features & Capabilities:** **Content Quality Standards:** - **SEO Optimization:** Natural keyword integration with LSI keywords and related terms - **Readability:** Conversational tone with short sentences and clear explanations - **Structure:** Proper HTML formatting with headings, lists, and internal links - **Length:** Consistent 800-1000 word count for optimal engagement - **Audience Targeting:** Content tailored for Indian investor audience with relevant examples **Image Generation Specifications:** - **Resolution:** 1248x832 pixels optimized for blog headers - **Style:** Realistic professional imagery with human subjects - **Design:** Clean layout with heading text placement (bottom or left side) - **Quality:** High-resolution output suitable for web publishing - **Branding:** Light beige to gradient backgrounds with golden overlay effects **Error Handling & Reliability:** - **Graceful Failures:** Workflow continues even if individual steps encounter errors - **API Rate Limits:** Built-in delays and retry mechanisms for external services - **Data Validation:** Checks for required fields before processing - **Backup Processes:** Alternative paths for critical failure points - **Logging:** Comprehensive tracking of successes and failures **Security & Access Control:** - **Credential Encryption:** All API keys stored securely in n8n vault - **Limited Permissions:** Service accounts with minimum required access - **Authentication:** Basic auth for WordPress with encoded credentials - **Data Privacy:** No sensitive information exposed in logs or outputs - **Access Logging:** Track all sheet modifications and blog publications ## **Troubleshooting:** **Common Issues:** - **API Rate Limits:** Check your API quotas and usage limits - **WordPress Authentication:** Verify your basic auth credentials are correct - **Sheet Access:** Ensure Google Sheets API has proper permissions - **Image Generation Fails:** Check Ideogram API key and quotas ## **Need Help?:** **For technical support or questions:** **Email:** [[email protected]](mailto:[email protected]) **Contact Form:** [https://www.incrementors.com/contact-us/](https://www.incrementors.com/contact-us/)

Sitemap page extractor: Discover, clean, and save website URLs to Google Sheets

## **Description:** Automatically extracts all page URLs from website sitemaps, filters out unwanted sitemap links, and saves clean URLs to Google Sheets for SEO analysis and reporting. ## **How It Works:** This workflow automates the process of discovering and extracting all page URLs from a website's sitemap structure. Here's how it works step-by-step: **Step 1:** URL Input The workflow starts when you submit a website URL through a simple form interface. **Step 2:** Sitemap Discovery The system automatically generates and tests multiple possible sitemap URLs including /sitemap.xml, /sitemap_index.xml, /robots.txt, and other common variations. **Step 3:** Valid Sitemap Identification It sends HTTP requests to each potential sitemap URL and filters out empty or invalid responses, keeping only accessible sitemaps. **Step 4:** Nested Sitemap Processing For sitemap index files, the workflow extracts all nested sitemap URLs and processes each one individually to ensure complete coverage. **Step 5:** Page URL Extraction From each valid sitemap, it parses the XML content and extracts all individual page URLs using both XML <loc> tags and HTML links. **Step 6:** URL Filtering The system removes any URLs containing "sitemap" to ensure only actual content pages (like product, service, or blog pages) are retained. **Step 7:** Google Sheets Integration Finally, all clean page URLs are automatically saved to a Google Sheets document with duplicate prevention for easy analysis and reporting. ## **Setup Steps:** **Estimated Setup Time:** 10-15 minutes **1. Import the Workflow:** Import the provided JSON file into your n8n instance. **2. Configure Google Sheets Integration:** - Set up Google Sheets OAuth2 credentials in n8n - Create a new Google Sheet or use an existing one - Update the "Save Page URLs to Sheet" node with your Google Sheet URL - Ensure your sheet has a tab named "Your sheet tab name" with a column header "Column name" **3. Test the Workflow:** - Activate the workflow in n8n - Use the form trigger URL to submit a test website URL - Verify that URLs are being extracted and saved to your Google Sheet **4. Customize (Optional):** - Modify the sitemap URL patterns in the "Build sitemap URLs" node if needed - Adjust the filtering criteria in the "Exclude the Sitemap URLs" node - Update the Google Sheets column mapping as required ## **Important Notes:** - Ensure your Google Sheets credentials have proper read/write permissions - The workflow handles both XML sitemaps and robots.txt sitemap references - Duplicate URLs are automatically prevented when saving to Google Sheets - The workflow continues processing even if some sitemap URLs are inaccessible ## **Need Help?** For technical support or questions about this workflow: ✉️ [[email protected]](mailto:[email protected]) or fill out this form: [Contact Us](https://www.incrementors.com/contact-us/)

Extract market cap data from Yahoo Finance with Bright Data & visualize in Telegram

# Financial Insight Automation: Market Cap to Telegram via Bright Data ## 📊 Description An automated n8n workflow that scrapes financial data from Yahoo Finance using Bright Data, processes market cap information, generates visual charts, and sends comprehensive financial insights directly to Telegram for instant notifications. --- ## 🚀 How It Works This workflow operates through a simple three-zone process: ### 1. Data Input & Trigger User submits a keyword (e.g., "AI", "Crypto", "MSFT") through a form trigger that initiates the financial data collection process. ### 2. Data Scraping & Processing Bright Data API discovers and scrapes comprehensive financial data from Yahoo Finance, including market cap, stock prices, company profiles, and financial metrics. ### 3. Visualization & Delivery The system generates interactive market cap charts, saves data to Google Sheets for record-keeping, and sends visual insights to Telegram as PNG images. --- ## ⚡ Setup Steps > **⏱️ Estimated Setup Time: 15-20 minutes** ### Prerequisites - Active n8n instance (self-hosted or cloud) - Bright Data account with Yahoo Finance dataset access - Google account for Sheets integration - Telegram bot token and chat ID ### Step 1: Import the Workflow 1. Copy the provided JSON workflow code 2. In n8n: Go to **Workflows → + Add workflow → Import from JSON** 3. Paste the JSON content and click **Import** ### Step 2: Configure Bright Data Integration #### Set up Bright Data Credentials: 1. In n8n: Navigate to **Credentials → + Add credential → HTTP Header Auth** 2. Add Authorization header with value: `Bearer BRIGHT_DATA_API_KEY` 3. Replace `BRIGHT_DATA_API_KEY` with your actual API key 4. Test the connection to ensure it works properly > **Note:** The workflow uses dataset ID `gd_lmrpz3vxmz972ghd7` for Yahoo Finance data. Ensure you have access to this dataset in your Bright Data dashboard. ### Step 3: Set up Google Sheets Integration #### Create a Google Sheet: - Go to Google Sheets and create a new spreadsheet - Name it "Financial Data Tracker" or similar - Copy the Sheet ID from the URL #### Configure Google Sheets credentials: - In n8n: **Credentials → + Add credential → Google Sheets OAuth2 API** - Complete OAuth setup and test connection #### Update the workflow: - Open the "📊 Filtered Output & Save to Sheet" node - Replace `YOUR_SHEET_ID` with your actual Sheet ID - Select your Google Sheets credential ### Step 4: Configure Telegram Bot #### Set up Telegram Integration: 1. Create a Telegram bot using @BotFather 2. Get your bot token and chat ID 3. In n8n: **Credentials → + Add credential → Telegram API** 4. Enter your bot token 5. Update the "📤 Send Chart on Telegram" node with your chat ID 6. Replace `YOUR_TELEGRAM_CHAT_ID` with your actual chat ID ### Step 5: Test and Activate #### Test the workflow: - Use the form trigger with a test keyword (e.g., "AAPL") - Monitor the execution in n8n - Verify data appears in Google Sheets - Check for chart delivery on Telegram #### Activate the workflow: - Turn on the workflow using the toggle switch - The form trigger will be accessible via the provided webhook URL --- ## 📋 Key Features - 🔍 **Keyword-Based Discovery:** Search companies by keyword, ticker, or industry - 💰 **Comprehensive Financial Data:** Market cap, stock prices, earnings, and company profiles - 📊 **Visual Charts:** Automatic generation of market cap comparison charts - 📱 **Telegram Integration:** Instant delivery of insights to your mobile device - 💾 **Data Storage:** Automatic backup to Google Sheets for historical tracking - ⚡ **Real-time Processing:** Fast data retrieval and processing with Bright Data --- ## 📊 Output Data Points | Field | Description | Example | |-------|-------------|---------| | Company Name | Full company name | "Apple Inc." | | Stock Ticker | Trading symbol | "AAPL" | | Market Cap | Total market capitalization | "$2.89T" | | Current Price | Latest stock price | "$189.25" | | Exchange | Stock exchange | "NASDAQ" | | Sector | Business sector | "Technology" | | PE Ratio | Price to earnings ratio | "28.45" | | 52 Week Range | Annual high and low prices | "$164.08 - $199.62" | --- ## 🔧 Troubleshooting ### Common Issues #### Bright Data Connection Failed: - Verify your API key is correct and active - Check dataset permissions in Bright Data dashboard - Ensure you have sufficient credits #### Google Sheets Permission Denied: - Re-authenticate Google Sheets OAuth - Verify sheet sharing settings - Check if the Sheet ID is correct #### Telegram Not Receiving Messages: - Verify bot token and chat ID - Check if bot is added to the chat - Test Telegram credentials manually ### Performance Tips - Use specific keywords for better data accuracy - Monitor Bright Data usage to control costs - Set up error handling for failed requests - Consider rate limiting for high-volume usage --- ## 🎯 Use Cases - **Investment Research:** Quick financial analysis of companies and sectors - **Market Monitoring:** Track market cap changes and stock performance - **Competitive Analysis:** Compare financial metrics across companies - **Portfolio Management:** Monitor holdings and potential investments - **Financial Reporting:** Generate automated financial insights for teams --- ## 🔗 Additional Resources - [n8n Documentation](https://docs.n8n.io) - [Bright Data Datasets](https://brightdata.com/datasets) - [Google Sheets API](https://developers.google.com/sheets/api) - [Telegram Bot API](https://core.telegram.org/bots/api) --- For any questions or support, please contact: [[email protected]](mailto:[email protected]) or fill out this form: [https://www.incrementors.com/contact-us/](https://www.incrementors.com/contact-us/)

Generate LinkedIn posts from Wikipedia with GPT-4 summaries and Ideogram images

# Wikipedia to LinkedIn AI Content Poster with Image via Bright Data ## 📋 Overview **Workflow Description:** Automatically scrapes Wikipedia articles, generates AI-powered LinkedIn summaries with custom images, and posts professional content to LinkedIn using Bright Data extraction and intelligent content optimization. --- ## 🚀 How It Works The workflow follows these simple steps: 1. **Article Input:** User submits a Wikipedia article name through a simple form interface 2. **Data Extraction:** Bright Data scrapes the Wikipedia article content including title and full text 3. **AI Summarization:** Advanced AI models (OpenAI GPT-4 or Claude) create professional LinkedIn-optimized summaries under 2000 characters 4. **Image Generation:** Ideogram AI creates relevant visual content based on the article summary 5. **LinkedIn Publishing:** Automatically posts the summary with generated image to your LinkedIn profile 6. **URL Generation:** Provides a shareable LinkedIn post URL for easy access and sharing --- ## ⚡ Setup Requirements **Estimated Setup Time: 10-15 minutes** ### Prerequisites - n8n instance (self-hosted or cloud) - Bright Data account with Wikipedia dataset access - OpenAI API account (for GPT-4 access) - Anthropic API account (for Claude access - optional) - Ideogram AI account (for image generation) - LinkedIn account with API access --- ## 🔧 Configuration Steps ### Step 1: Import Workflow 1. Copy the provided JSON workflow file 2. In n8n: Navigate to `Workflows → + Add workflow → Import from JSON` 3. Paste the JSON content and click **Import** 4. Save the workflow with a descriptive name ### Step 2: Configure API Credentials #### 🌐 Bright Data Setup - Go to `Credentials → + Add credential → Bright Data API` - Enter your Bright Data API token - Replace `BRIGHT_DATA_API_KEY` in all HTTP request nodes - Test the connection to ensure access #### 🤖 OpenAI Setup - Configure OpenAI credentials in n8n - Ensure GPT-4 model access - Link credentials to the "OpenAI Chat Model" node - Test API connectivity #### 🎨 Ideogram AI Setup - Obtain Ideogram AI API key - Replace `IDEOGRAM_API_KEY` in the "Image Generate" node - Configure image generation parameters - Test image generation functionality #### 💼 LinkedIn Setup - Set up LinkedIn OAuth2 credentials in n8n - Replace `LINKEDIN_PROFILE_ID` with your profile ID - Configure posting permissions - Test posting functionality ### Step 3: Configure Workflow Parameters **Update Node Settings:** - **Form Trigger:** Customize the form title and field labels as needed - **AI Agent:** Adjust the system message for different content styles - **Image Generate:** Modify image resolution and rendering speed settings - **LinkedIn Post:** Configure additional fields like hashtags or mentions ### Step 4: Test the Workflow **Testing Recommendations:** - Start with a simple Wikipedia article (e.g., "Artificial Intelligence") - Monitor each node execution for errors - Verify the generated summary quality - Check image generation and LinkedIn posting - Confirm the final LinkedIn URL generation --- ## 🎯 Usage Instructions ### Running the Workflow 1. **Access the Form:** Use the generated webhook URL to access the submission form 2. **Enter Article Name:** Type the exact Wikipedia article title you want to process 3. **Submit Request:** Click submit to start the automated process 4. **Monitor Progress:** Check the n8n execution log for real-time progress 5. **View Results:** The workflow will return a LinkedIn post URL upon completion ### Expected Output #### 📝 Content Summary - Professional LinkedIn-optimized text - Under 2000 characters - Engaging and informative tone - Bullet points for readability #### 🖼️ Generated Image - High-quality AI-generated visual - 1280x704 resolution - Relevant to article content - Professional appearance #### 🔗 LinkedIn Post - Published to your LinkedIn profile - Includes both text and image - Shareable public URL - Professional formatting --- ## 🛠️ Customization Options ### Content Personalization - **AI Prompts:** Modify the system message in the AI Agent node to change writing style - **Character Limits:** Adjust summary length requirements - **Tone Settings:** Change from professional to casual or technical - **Hashtag Integration:** Add relevant hashtags to LinkedIn posts ### Visual Customization - **Image Style:** Modify Ideogram prompts for different visual styles - **Resolution:** Change image dimensions based on LinkedIn requirements - **Rendering Speed:** Balance between speed and quality - **Brand Elements:** Include company logos or brand colors --- ## 🔍 Troubleshooting ### Common Issues & Solutions #### ⚠️ Bright Data Connection Issues - Verify API key is correctly configured - Check dataset access permissions - Ensure sufficient API credits - Validate Wikipedia article exists #### 🤖 AI Processing Errors - Check OpenAI API quotas and limits - Verify model access permissions - Review input text length and format - Test with simpler article content #### 🖼️ Image Generation Failures - Validate Ideogram API key - Check image prompt content - Verify API usage limits - Test with shorter prompts #### 💼 LinkedIn Posting Issues - Re-authenticate LinkedIn OAuth - Check posting permissions - Verify profile ID configuration - Test with shorter content --- ## ⚡ Performance & Limitations ### Expected Processing Times - **Wikipedia Scraping:** 30-60 seconds - **AI Summarization:** 15-30 seconds - **Image Generation:** 45-90 seconds - **LinkedIn Posting:** 10-15 seconds - **Total Workflow:** 2-4 minutes per article ### Usage Recommendations **Best Practices:** - Use well-known Wikipedia articles for better results - Monitor API usage across all services - Test content quality before bulk processing - Respect LinkedIn posting frequency limits - Keep backup of successful configurations --- ## 📊 Use Cases ### 📚 Educational Content Create engaging educational posts from Wikipedia articles on science, history, or technology topics. ### 🏢 Thought Leadership Transform complex topics into accessible LinkedIn content to establish industry expertise. ### 📰 Content Marketing Generate regular, informative posts to maintain active LinkedIn presence with minimal effort. ### 🔬 Research Sharing Quickly summarize and share research findings or scientific discoveries with your network. --- ## 🎉 Conclusion This workflow provides a powerful, automated solution for creating professional LinkedIn content from Wikipedia articles. By combining web scraping, AI summarization, image generation, and social media posting, you can maintain an active and engaging LinkedIn presence with minimal manual effort. The workflow is designed to be flexible and customizable, allowing you to adapt the content style, visual elements, and posting frequency to match your professional brand and audience preferences. For any questions or support, please contact: [[email protected]](mailto:[email protected]) or fill out this form: [https://www.incrementors.com/contact-us/](https://www.incrementors.com/contact-us/)

Multi-platform price finder: Scraping prices with Bright Data, Claude AI & Telegram

*This workflow contains community nodes that are only compatible with the self-hosted version of n8n.* # 📦 Multi-Platform Price Finder: Scraping Prices with Bright Data & Telegram An intelligent n8n automation that fetches real-time product prices from marketplaces like Amazon, Wayfair, Lowe's, and more using Bright Data's dataset, and sends promotional messages via Telegram using AI—perfect for price tracking, deal alerts, and affiliate monetization. --- ## 📋 Overview This automation tracks product prices across top e-commerce platforms using Bright Data and sends out alerts via Telegram based on the best available deals. The workflow is designed for affiliate marketers, resellers, and deal-hunting platforms who want real-time competitive pricing. --- ## ✨ Key Features - 🔎 **Multi-Platform Scraping**: Supports Amazon, Wayfair, Lowe's, and more - ⚡ **Bright Data Integration**: Access to structured product snapshots - 📢 **AI-Powered Alerts**: Generates Telegram-ready promo messages using AI - 🧠 **Lowest Price Logic**: Filters and compares products across sources - 📈 **Data Merge & Processing**: Combines multiple sources into a single stream - 🔄 **Keyword-Driven Search**: Searches using dynamic keywords from form input - 📦 **Scalable Design**: Built for multiple platform processing simultaneously - 🧼 **Clean Output**: Strips unnecessary formatting before publishing --- ## 🎯 What This Workflow Does ### **Input** - **Search Keywords**: User-defined keyword(s) from a form trigger - **Platform Sources**: Wayfair, Lowe's, Amazon, etc. - **Bright Data API Key**: Needed for authenticated scraping ### **Processing Steps** 1. **User Input** via n8n form trigger (keyword-based) 2. **Bright Data API Trigger** for each marketplace 3. **Status Polling**: Wait until scraping snapshot is `ready` 4. **Data Retrieval**: Fetches JSON results from Bright Data snapshot 5. **Data Cleaning & Normalization**: Price, title, and URL are extracted 6. **Merging Products** from all platforms 7. **Find Lowest Price Product** using custom JS logic 8. **AI Prompt Generation** via Claude/Anthropic 9. **Telegram Formatting** and alert message creation ### **Output** - 🛍️ Product Title - 💰 Final Price - 🔗 Product URL - ✉️ Promotional Message (for Telegram/notifications) --- ## 🚀 Setup Instructions ### **Step 1: Import Workflow** 1. Open n8n > Workflows > **+ Add Workflow** 2. Import the provided JSON file ### **Step 2: Configure Bright Data** - Add credentials under **Credentials → Bright Data API** - Set the appropriate `dataset_id` for each platform - Ensure dataset includes `title`, `price`, and `url` fields ### **Step 3: Enable Keyword Trigger** - Use the built-in `Form Trigger` node - Input: Single keyword field (SearchHere) ### **Step 4: Telegram or AI Integration** - Modify prompt node for your language or tone - Add Telegram webhook or integration where needed --- ## 📖 Usage Guide ### Adding Keywords - Trigger the form with a product keyword like `iPhone 15` - Wait for workflow to fetch best deals and generate Telegram message ### Understanding AI-Powered Output - AI creates a short, engaging message like: > "🔥 Deal Alert: Get the iPhone 15 for just ₹74,999! Limited stock—Check it out: [link]" ### Debugging Output - Output node shows cleaned JSON with `title`, `price`, `url`, and `message` - If no valid results, debug message is returned with sample structure info --- ## 🔧 Customization Options ### Add More Marketplaces - Clone any HTTP Request node (e.g., for Wayfair) - Update `dataset_id` and required output fields ### Modify Price Logic - Update the `Code1` node to change comparison (e.g., highest price instead of lowest) ### Change Message Format - Edit the `AI Agent` prompt to customize tone/language - Add emoji, CTAs, or markdown formatting as needed --- ## 🧪 Test & Activation - Add a few sample keywords via form trigger - Run manually or set as a webhook for external app input - Check final AI-generated message in output node --- ## 🚨 Troubleshooting | Issue | Solution | |-------|----------| | **No Data Returned** | Ensure keyword matches real products | | **Status Not 'Ready'** | Bright Data delay; add `Wait` nodes | | **Invalid API Key** | Check Bright Data credentials | | **AI Errors** | Adjust prompt or validate input fields | --- ## 📊 Use Cases - 💰 **Affiliate Campaigns**: Show best deals across platforms - 🛒 **Deal Pages**: Post live offers with product links - 🧠 **Competitor Analysis**: Track cross-platform pricing - 🔔 **Alert Bots**: Send real-time alerts to Telegram or Slack --- ## ✅ Quick Setup Checklist - [x] Bright Data API credentials configured - [x] n8n form trigger enabled - [x] Claude or AI model connected - [x] All HTTP requests working - [x] AI message formatting verified --- ## 🌐 Example Output ```json { "title": "Apple iPhone 15 Pro Max", "price": 1199, "url": "https://amazon.com/iphone-15", "message": "🔥 Grab the Apple iPhone 15 Pro Max for just $1199! Limited deal—Check it out: https://amazon.com/iphone-15" } ``` --- ## 📬For any questions or support, please contact: 📧 <[email protected]> or fill out this form: [https://www.incrementors.com/contact-us/](https://www.incrementors.com/contact-us/)

Scrape Twitter profiles with Bright Data API and export to Google Sheets

# 🐦 Twitter Profile Scraper via Bright Data API with Google Sheets Output A comprehensive n8n automation that scrapes Twitter profile data using Bright Data's Twitter dataset and stores comprehensive tweet analytics, user metrics, and engagement data directly into Google Sheets. ## 📋 Overview This workflow provides an automated Twitter data collection solution that extracts profile information and tweet data from specified Twitter accounts within custom date ranges. Perfect for social media analytics, competitor research, brand monitoring, and content strategy analysis. ## ✨ Key Features 🔗 **Form-Based Input**: Easy-to-use form for Twitter URL and date range selection 🐦 **Twitter Integration**: Uses Bright Data's Twitter dataset for accurate data extraction 📊 **Comprehensive Data**: Captures tweets, engagement metrics, and profile information 📈 **Google Sheets Storage**: Automatically stores all data in organized spreadsheet format 🔄 **Progress Monitoring**: Real-time status tracking with automatic retry mechanisms ⚡ **Fast & Reliable**: Professional scraping with built-in error handling 📅 **Date Range Control**: Flexible time period selection for targeted data collection 🎯 **Customizable Fields**: Advanced data field selection and mapping ## 🎯 What This Workflow Does ### Input - **Twitter Profile URL**: Target Twitter account for data scraping - **Date Range**: Start and end dates for tweet collection period - **Custom Fields**: Configurable data points to extract ### Processing 1. **Form Trigger**: Collects Twitter URL and date range from user input 2. **API Request**: Sends scraping request to Bright Data with specified parameters 3. **Progress Monitoring**: Continuously checks scraping job status until completion 4. **Data Retrieval**: Downloads complete dataset when scraping is finished 5. **Data Processing**: Formats and structures extracted information 6. **Sheet Integration**: Automatically populates Google Sheets with organized data ### Output Data Points | Field | Description | Example | |-------|-------------|---------| | user_posted | Username who posted the tweet | @elonmusk | | name | Display name of the user | Elon Musk | | description | Tweet content/text | "Exciting updates coming soon..." | | date_posted | When the tweet was posted | 2025-01-15T10:30:00Z | | likes | Number of likes on the tweet | 1,234 | | reposts | Number of retweets | 567 | | replies | Number of replies | 89 | | views | Total view count | 12,345 | | followers | User's follower count | 50M | | following | Users they follow | 123 | | is_verified | Verification status | true/false | | hashtags | Hashtags used in tweet | #AI #Technology | | photos | Image URLs in tweet | image1.jpg, image2.jpg | | videos | Video content URLs | video1.mp4 | | user_id | Unique user identifier | 12345678 | | timestamp | Data extraction timestamp | 2025-01-15T11:00:00Z | ## 🚀 Setup Instructions ### Prerequisites - n8n instance (self-hosted or cloud) - Bright Data account with Twitter dataset access - Google account with Sheets access - Valid Twitter profile URLs to scrape - 10-15 minutes for setup ### Step 1: Import the Workflow 1. Copy the JSON workflow code from the provided file 2. In n8n: Workflows → + Add workflow → Import from JSON 3. Paste JSON and click Import ### Step 2: Configure Bright Data 1. Set up Bright Data credentials: - In n8n: Credentials → + Add credential → HTTP Header Auth - Enter your Bright Data API credentials - Test the connection 2. Configure dataset: - Ensure you have access to Twitter dataset (`gd_lwxkxvnf1cynvib9co`) - Verify dataset permissions in Bright Data dashboard ### Step 3: Configure Google Sheets Integration 1. Create a Google Sheet: - Go to Google Sheets - Create a new spreadsheet named "Twitter Data" or similar - Copy the Sheet ID from URL: `https://docs.google.com/spreadsheets/d/SHEET_ID_HERE/edit` 2. Set up Google Sheets credentials: - In n8n: Credentials → + Add credential → Google Sheets OAuth2 API - Complete OAuth setup and test connection 3. Prepare your data sheet with columns: - Use the column headers from the data points table above - The workflow will automatically populate these fields ### Step 4: Update Workflow Settings 1. Update Bright Data nodes: - Open "🚀 Trigger Twitter Scraping" node - Replace `BRIGHT_DATA_API_KEY` with your actual API token - Verify dataset ID is correct 2. Update Google Sheets node: - Open "📊 Store Twitter Data in Google Sheet" node - Replace `YOUR_GOOGLE_SHEET_ID` with your Sheet ID - Select your Google Sheets credential - Choose the correct sheet/tab name ### Step 5: Test & Activate 1. Add test data: - Use the form trigger to input a Twitter profile URL - Set a small date range for testing (e.g., last 7 days) 2. Test the workflow: - Submit the form to trigger the workflow - Monitor progress in n8n execution logs - Verify data appears in Google Sheet - Check all expected columns are populated ## 📖 Usage Guide ### Running the Workflow 1. Access the workflow form trigger URL (available when workflow is active) 2. Enter the Twitter profile URL you want to scrape 3. Set the start and end dates for tweet collection 4. Submit the form to initiate scraping 5. Monitor progress - the workflow will automatically check status every minute 6. Once complete, data will appear in your Google Sheet ### Understanding the Data Your Google Sheet will show: - **Real-time tweet data** for the specified date range - **User engagement metrics** (likes, replies, retweets, views) - **Profile information** (followers, following, verification status) - **Content details** (hashtags, media URLs, quoted tweets) - **Timestamps** for each tweet and data extraction ### Customizing Date Ranges - **Recent data**: Use last 7-30 days for current activity analysis - **Historical analysis**: Select specific months or quarters for trend analysis - **Event tracking**: Focus on specific date ranges around events or campaigns - **Comparative studies**: Use consistent time periods across different profiles ## 🔧 Customization Options ### Modifying Data Fields Edit the `custom_output_fields` array in the "🚀 Trigger Twitter Scraping" node to add or remove data points: ```json "custom_output_fields": [ "id", "user_posted", "name", "description", "date_posted", "likes", "reposts", "replies", "views", "hashtags", "followers", "is_verified" ] ``` ### Changing Google Sheet Structure Modify the column mapping in the "📊 Store Twitter Data in Google Sheet" node to match your preferred sheet layout and add custom formulas or calculations. ### Adding Multiple Recipients To process multiple Twitter profiles: 1. Modify the form to accept multiple URLs 2. Add a loop node to process each URL separately 3. Implement delays between requests to respect rate limits ## 🚨 Troubleshooting ### Common Issues & Solutions 1. **"Bright Data connection failed"** - **Cause**: Invalid API credentials or dataset access - **Solution**: Verify credentials in Bright Data dashboard, check dataset permissions 2. **"No data extracted"** - **Cause**: Invalid Twitter URLs or private/protected accounts - **Solution**: Verify URLs are valid public Twitter profiles, test with different accounts 3. **"Google Sheets permission denied"** - **Cause**: Incorrect credentials or sheet permissions - **Solution**: Re-authenticate Google Sheets, check sheet sharing settings 4. **"Workflow timeout"** - **Cause**: Large date ranges or high-volume accounts - **Solution**: Use smaller date ranges, implement pagination for high-volume accounts 5. **"Progress monitoring stuck"** - **Cause**: Scraping job failed or API issues - **Solution**: Check Bright Data dashboard for job status, restart workflow if needed ### Advanced Troubleshooting - Check execution logs in n8n for detailed error messages - Test individual nodes by running them separately - Verify data formats and ensure consistent field mapping - Monitor rate limits if scraping multiple profiles consecutively - Add error handling and implement retry logic for robust operation ## 📊 Use Cases & Examples ### 1. Social Media Analytics **Goal**: Track engagement metrics and content performance - Monitor tweet engagement rates over time - Analyze hashtag effectiveness and reach - Track follower growth and audience interaction - Generate weekly/monthly performance reports ### 2. Competitor Research **Goal**: Monitor competitor social media activity - Track competitor posting frequency and timing - Analyze competitor content themes and strategies - Monitor competitor engagement and audience response - Identify trending topics and hashtags in your industry ### 3. Brand Monitoring **Goal**: Track brand mentions and sentiment analysis - Monitor specific Twitter accounts for brand mentions - Track hashtag campaigns and user-generated content - Analyze sentiment trends and audience feedback - Identify influencers and brand advocates ### 4. Content Strategy Development **Goal**: Analyze successful content patterns - Identify high-performing tweet formats and topics - Track optimal posting times and frequencies - Analyze hashtag performance and reach - Study audience engagement patterns ### 5. Market Research **Goal**: Collect social media data for market analysis - Gather consumer opinions and feedback - Track industry trends and discussions - Monitor product launches and market reactions - Support product development with social insights ## ⚙ Advanced Configuration ### Batch Processing Multiple Profiles To monitor multiple Twitter accounts efficiently: 1. Create a master sheet with profile URLs and date ranges 2. Add a loop node to process each profile separately 3. Implement delays between requests to respect rate limits 4. Use separate sheets or tabs for different profiles ### Adding Data Analysis Enhance the workflow with analytical capabilities: 1. Create additional sheets for processed data and insights 2. Add formulas to calculate engagement rates and trends 3. Implement data visualization with charts and graphs 4. Generate automated reports and summaries ### Integration with Business Tools Connect the workflow to your existing systems: - **CRM Integration**: Update customer records with social media data - **Slack Notifications**: Send alerts when data collection is complete - **Database Storage**: Store data in PostgreSQL/MySQL for advanced analysis - **BI Tools**: Connect to Tableau/Power BI for comprehensive visualization ## 📈 Performance & Limits ### Expected Performance - **Single profile**: 30 seconds to 5 minutes (depending on date range) - **Data accuracy**: 95%+ for public Twitter profiles - **Success rate**: 90%+ for accessible accounts - **Daily capacity**: 10-50 profiles (depends on rate limits and data volume) ### Resource Usage - **Memory**: ~200MB per execution - **Storage**: Minimal (data stored in Google Sheets) - **API calls**: 1 Bright Data call + multiple Google Sheets calls per profile - **Bandwidth**: ~5-10MB per profile scraped - **Execution time**: 2-10 minutes for typical date ranges ### Scaling Considerations - **Rate limiting**: Add delays for high-volume scraping - **Error handling**: Implement retry logic for failed requests - **Data validation**: Add checks for malformed or missing data - **Monitoring**: Track success/failure rates over time - **Cost optimization**: Monitor API usage to control costs ## 🤝 Support & Community ### Getting Help - **n8n Community Forum**: community.n8n.io - **Documentation**: docs.n8n.io - **Bright Data Support**: Contact through your dashboard - **GitHub Issues**: Report bugs and feature requests ### Contributing - Share improvements with the community - Report issues and suggest enhancements - Create variations for specific use cases - Document best practices and lessons learned ## 📋 Quick Setup Checklist ### Before You Start ☐ n8n instance running (self-hosted or cloud) ☐ Bright Data account with Twitter dataset access ☐ Google account with Sheets access ☐ Valid Twitter profile URLs ready for scraping ☐ 10-15 minutes available for setup ### Setup Steps ☐ **Import Workflow** - Copy JSON and import to n8n ☐ **Configure Bright Data** - Set up API credentials and test ☐ **Create Google Sheet** - New sheet with proper column structure ☐ **Set up Google Sheets credentials** - OAuth setup and test ☐ **Update workflow settings** - Replace API keys and sheet IDs ☐ **Test with sample data** - Add 1 Twitter URL and small date range ☐ **Verify data flow** - Check data appears in Google Sheet correctly ☐ **Activate workflow** - Enable form trigger for production use ## Ready to Use! 🎉 **Your workflow URL**: Access form trigger when workflow is active 🎯 **Happy Twitter Scraping!** This workflow provides a solid foundation for automated Twitter data collection. Customize it to fit your specific social media analytics and research needs. For any questions or support, please contact: [[email protected]](mailto:[email protected]) or fill out this form: [https://www.incrementors.com/contact-us/](https://www.incrementors.com/contact-us/)

Yelp business scraper by URL with Bright Data API and Google Sheets

# Yelp Business Scraper by URL via Bright Data API with Google Sheets Storage ## Overview This n8n workflow automates the process of scraping comprehensive business information from Yelp using individual business URLs. It integrates with Bright Data for professional web scraping and Google Sheets for centralized data storage, providing detailed business intelligence for market research, competitor analysis, and lead generation. ## Workflow Components ### 1. 📥 **Form Trigger** - **Type**: Form Trigger - **Purpose**: Initiates the workflow with user-submitted Yelp business URL - **Input Fields**: - URL (Yelp business page URL) - **Function**: Captures target business URL to start the scraping process ### 2. 🔍 **Trigger Bright Data Scrape** - **Type**: HTTP Request (POST) - **Purpose**: Sends scraping request to Bright Data API for Yelp business data - **Endpoint**: `https://api.brightdata.com/datasets/v3/trigger` - **Parameters**: - Dataset ID: `gd_lgugwl0519h1p14rwk` - Include errors: true - Limit multiple results: 5 - Limit per input: 20 - **Function**: Initiates comprehensive business data extraction from Yelp ### 3. 📡 **Monitor Snapshot Status** - **Type**: HTTP Request (GET) - **Purpose**: Monitors the progress of the Yelp scraping job - **Endpoint**: `https://api.brightdata.com/datasets/v3/progress/{snapshot_id}` - **Function**: Checks if the business data scraping is complete ### 4. ⏳ **Wait 30 Sec for Snapshot** - **Type**: Wait Node - **Purpose**: Implements intelligent polling mechanism - **Duration**: 30 seconds - **Function**: Pauses workflow before rechecking scraping status to optimize API usage ### 5. 🔁 **Retry Until Ready** - **Type**: IF Condition - **Purpose**: Evaluates scraping completion status - **Condition**: `status === "ready"` - **Logic**: - True: Proceeds to data retrieval - False: Loops back to status monitoring with wait ### 6. 📥 **Fetch Scraped Business Data** - **Type**: HTTP Request (GET) - **Purpose**: Retrieves the final scraped business information - **Endpoint**: `https://api.brightdata.com/datasets/v3/snapshot/{snapshot_id}` - **Format**: JSON - **Function**: Downloads completed Yelp business data with comprehensive details ### 7. 📊 **Store to Google Sheet** - **Type**: Google Sheets Node - **Purpose**: Stores scraped business data for analysis and storage - **Operation**: Append rows - **Target**: "Yelp scraper data by URL" sheet - **Data Mapping**: - Business Name, Overall Rating, Reviews Count - Business URL, Images/Videos URLs - Additional business metadata fields ## Workflow Flow ``` Form Input → Trigger Scrape → Monitor Status → Wait 30s → Check Ready ↑ ↓ └─── Loop ─────┘ ↓ Fetch Data → Store to Sheet ``` ## Configuration Requirements ### API Keys & Credentials - **Bright Data API Key**: Required for Yelp business scraping - **Google Sheets OAuth2**: For data storage and export access - **n8n Form Webhook**: For user input collection ### Setup Parameters - **Google Sheet ID**: Target spreadsheet identifier - **Dataset ID**: `gd_lgugwl0519h1p14rwk` (Yelp business scraper) - **Form Webhook ID**: User input form identifier - **Google Sheets Credential ID**: OAuth2 authentication ## Key Features ### **Comprehensive Business Data Extraction** - Complete business profile information - Customer ratings and review counts - Contact details and business hours - Photo and video content URLs - Location and category information ### **Intelligent Status Monitoring** - Real-time scraping progress tracking - Automatic retry mechanisms with 30-second intervals - Status validation before data retrieval - Error handling and timeout management ### **Centralized Data Storage** - Automatic Google Sheets export - Organized business data format - Historical scraping records - Easy sharing and collaboration ### **URL-Based Processing** - Direct Yelp business URL input - Single business deep-dive analysis - Flexible input through web form - Real-time workflow triggering ## Use Cases ### **Market Research** - Competitor business analysis - Local market intelligence gathering - Industry benchmark establishment - Service offering comparison ### **Lead Generation** - Business contact information extraction - Potential client identification - Market opportunity assessment - Sales prospect development ### **Business Intelligence** - Customer sentiment analysis through ratings - Competitor performance monitoring - Market positioning research - Brand reputation tracking ### **Location Analysis** - Geographic business distribution - Local competition assessment - Market saturation evaluation - Expansion opportunity identification ## Data Output Fields | Field | Description | Example | |-------|-------------|---------| | Name | Business name | "Joe's Pizza Restaurant" | | Overall Rating | Average customer rating | "4.5" | | Reviews Count | Total number of reviews | "247" | | URL | Original Yelp business URL | "https://www.yelp.com/biz/joes-pizza..." | | Images/Videos URLs | Media content links | "https://s3-media1.fl.yelpcdn.com/..." | ## Technical Notes - **Polling Interval**: 30-second status checks for optimal API usage - **Result Limiting**: Maximum 20 businesses per input, 5 multiple results - **Data Format**: JSON with structured field mapping - **Error Handling**: Comprehensive error tracking in all API requests - **Retry Logic**: Automatic status rechecking until completion - **Form Input**: Single URL field with validation - **Storage Format**: Structured Google Sheets with predefined columns ## Setup Instructions ### Step 1: Import Workflow 1. Copy the JSON workflow configuration 2. Import into n8n: **Workflows** → **Import from JSON** 3. Paste configuration and save ### Step 2: Configure Bright Data 1. **Set up credentials:** - Navigate to **Credentials** → **Add Bright Data API** - Enter your Bright Data API key - Test connection 2. **Update API key references:** - Replace `BRIGHT_DATA_API_KEY` in all HTTP request nodes - Verify dataset access for `gd_lgugwl0519h1p14rwk` ### Step 3: Configure Google Sheets 1. **Create target spreadsheet:** - Create new Google Sheet named "Yelp Business Data" or similar - Copy the Sheet ID from URL 2. **Set up OAuth2 credentials:** - Add **Google Sheets OAuth2** credential in n8n - Complete authentication process 3. **Update workflow references:** - Replace `YOUR_GOOGLE_SHEET_ID` with actual Sheet ID - Update `YOUR_GOOGLE_SHEETS_CREDENTIAL_ID` with credential reference ### Step 4: Test and Activate 1. **Test with sample URL:** - Use a known Yelp business URL - Monitor execution progress - Verify data appears in Google Sheet 2. **Activate workflow:** - Toggle workflow to "Active" - Share form URL with users ## Sample Business Data The workflow captures comprehensive business information including: - **Basic Information**: Name, category, location - **Performance Metrics**: Ratings, review counts, popularity - **Contact Details**: Phone, website, address - **Visual Content**: Photos, videos, gallery URLs - **Operational Data**: Hours, services, amenities - **Customer Feedback**: Review summaries, sentiment indicators ## Advanced Configuration ### **Batch Processing** Modify the input to accept multiple URLs: ```json [ {"url": "https://www.yelp.com/biz/business-1"}, {"url": "https://www.yelp.com/biz/business-2"}, {"url": "https://www.yelp.com/biz/business-3"} ] ``` ### **Enhanced Data Fields** Add more extraction fields by updating the dataset configuration: - Business hours and schedule - Menu items and pricing - Customer photos and reviews - Special offers and promotions ### **Notification Integration** Add alert mechanisms: - Email notifications for completed scrapes - Slack messages for team updates - Webhook triggers for external systems ## Error Handling ### **Common Issues** - **Invalid URL**: Ensure URL is a valid Yelp business page - **Rate Limiting**: Bright Data API usage limits exceeded - **Authentication**: Google Sheets or Bright Data credential issues - **Data Format**: Unexpected response structure from Yelp ### **Troubleshooting Steps** 1. **Verify URLs**: Ensure Yelp business URLs are correctly formatted 2. **Check Credentials**: Validate all API keys and OAuth tokens 3. **Monitor Logs**: Review n8n execution logs for detailed errors 4. **Test Connectivity**: Verify network access to all external services ## Performance Specifications - **Processing Time**: 2-5 minutes per business URL - **Data Accuracy**: 95%+ for publicly available business information - **Success Rate**: 90%+ for valid Yelp business URLs - **Concurrent Processing**: Depends on Bright Data plan limits - **Storage Capacity**: Unlimited (Google Sheets based) --- **For any questions or support, please contact: [[email protected]](mailto:[email protected]) or fill out this form: [https://www.incrementors.com/contact-us/](https://www.incrementors.com/contact-us/)

# Discord Channel Creation Automation - n8n Workflow A comprehensive n8n automation that monitors Google Sheets for new project entries, automatically creates dedicated Discord channels, and sends formatted member notifications with all essential project details. ## 📋 Overview This workflow provides an automated Discord channel creation solution that eliminates manual channel setup and ensures consistent team communication. Perfect for agencies, development teams, and project-based organizations that need to streamline their Discord workspace management. ## ✨ Key Features - 🔍 **Automated Monitoring:** Continuously watches Google Sheets for new entries requiring Discord channels - 📢 **Discord Integration:** Creates dedicated channels using Discord API for organized communication - 📊 **Smart Filtering:** Only processes valid entries without existing Discord channels - 📧 **Member Notifications:** Sends formatted announcements with key project details - 📈 **Status Tracking:** Updates Google Sheets with Discord channel IDs and completion status - 🔄 **Sequential Processing:** Handles multiple channel requests with proper workflow sequencing - ⚡ **Error Handling:** Built-in validation and error management - 🎯 **Customizable Messages:** Flexible Discord notification templates ## 🎯 What This Workflow Does ### Input - **Sheet Data:** New entries in Google Sheets requiring Discord channels - **Discord Configuration:** Server and category settings for channel creation - **Notification Settings:** Member notification preferences and mentions ### Processing 1. **Monitor Trigger:** Watches Google Sheets for new row additions 2. **Data Validation:** Filters entries that need Discord channel creation 3. **Channel Creation:** Creates new Discord channel with specified naming convention 4. **Sheet Update:** Records Discord channel ID and status in Google Sheets 5. **Status Check:** Verifies successful channel creation before messaging 6. **Member Notification:** Sends formatted announcement to Discord channel 7. **Additional Details:** Sends follow-up message with supplementary information 8. **Completion Tracking:** Marks channel creation process as complete ### Output Data Points | Field | Description | Example | |-------|-------------|---------| | Entry ID | Unique identifier for the entry | ENTRY-2025-001 | | Title/Name | Name or title from the sheet entry | New Marketing Campaign | | Category/Type | Category or type of entry | Marketing Project | | Discord Channel ID | ID of created Discord channel | 1234567890123456789 | | Channel URL | Direct link to Discord channel | https://discord.com/channels/... | | Creation Status | Current status of channel creation process | Discord Created, Message Sent | | Timestamp | When the channel creation was completed | 2025-06-06T09:00:00Z | ## 🚀 Setup Instructions ### Prerequisites - n8n instance (self-hosted or cloud) - Google account with Sheets access - Discord server with bot permissions - 10-15 minutes for setup ### Step 1: Import the Workflow 1. Copy the JSON workflow code from the provided file 2. In n8n: **Workflows** → **+ Add workflow** → **Import from JSON** 3. Paste JSON and click **Import** ### Step 2: Configure Discord Integration 1. **Create Discord Bot:** - Go to Discord Developer Portal - Create new application and bot - Copy bot token for credentials - Add bot to your Discord server with proper permissions 2. **Set up Discord credentials:** - In n8n: **Credentials** → **+ Add credential** → **Discord Bot API** - Enter your Discord bot token - Test the connection 3. **Configure Discord settings:** - Note your Discord server (guild) ID - Create or identify the category for new project channels - Update guild ID and category ID in workflow nodes ### Step 3: Configure Google Sheets Integration 1. **Create Channel Request Sheet:** - Go to Google Sheets - Create new spreadsheet named "Discord Channel Requests" or similar - Copy the Sheet ID from URL: `https://docs.google.com/spreadsheets/d/SHEET_ID_HERE/edit` 2. **Set up Google Sheets credentials:** - In n8n: **Credentials** → **+ Add credential** → **Google Sheets OAuth2 API** - Complete OAuth setup and test connection 3. **Prepare your data sheet with required columns:** - **Column A:** Timestamp (auto-filled by form) - **Column B:** Entry Name/Title - **Column C:** Category/Type - **Column D:** Description - **Column E:** Contact/Owner Information - **Column F:** Entry ID - **Column G:** Discord ID (will be auto-filled) - **Column H:** Discord Channel Creation Status (will be auto-filled) ### Step 4: Update Workflow Settings 1. **Update Google Sheets nodes:** - Open "Monitor New Project Entries" node - Replace document ID with your Sheet ID - Select your Google Sheets credential - Choose correct sheet/tab name 2. **Update Discord nodes:** - Open all Discord nodes - Replace guild ID with your Discord server ID - Replace category ID with your project category ID - Select your Discord Bot credential 3. **Configure notification settings:** - Open Discord message nodes - Replace `[email protected]` with actual email if needed - Customize team mentions and message content - Adjust notification timing as needed ### Step 5: Test & Activate 1. **Add test entry:** - Add sample data to your Google Sheet - Ensure all required fields are filled - Leave Discord ID column empty for testing 2. **Test the workflow:** - Activate workflow (toggle switch) - Add new row to trigger workflow - Verify Discord channel creation - Check for member notifications - Confirm sheet updates ## 📖 Usage Guide ### Adding New Channel Requests 1. Navigate to your Google Sheets document 2. Add new entry with all required information 3. Leave Discord ID and status columns empty 4. Workflow will automatically process within minutes 5. Check Discord for new channel and notifications ### Understanding Status Updates The workflow uses intelligent status tracking: - **Empty Discord ID:** Entry needs channel creation - **"Discord Created":** Channel created, ready for notifications - **"Discord Created, Message Sent":** Process complete - **Error states:** Check execution logs for troubleshooting ### Customizing Member Notifications To modify notification content, edit Discord message nodes: - **Main announcement:** Update "Send Project Announcement Message" node - **Additional details:** Update "Send Additional Project Details" node - **Member mentions:** Replace `@everyone` with specific roles - **Message formatting:** Customize using Discord markdown ## 🔧 Customization Options ### Adding More Data Fields Edit Google Sheets trigger and message nodes to include: - Budget or resource information - Timeline and deadlines - Assigned team members or owners - Priority levels - Additional context or requirements ### Modifying Discord Structure Customize channel organization: ```javascript // Example: Add category to channel name "name": "{{ $json['Category/Type'] }}-{{ $json['Entry ID'] }}" // Example: Set channel topic "topic": "Channel for {{ $json['Title/Name'] }} - {{ $json['Category/Type'] }}" ``` ## 🚨 Troubleshooting ### Common Issues & Solutions | Issue | Cause | Solution | |-------|-------|----------| | "Discord permission denied" | Bot lacks required permissions in Discord server | Ensure bot has "Manage Channels" and "Send Messages" permissions | | "Google Sheets trigger not firing" | Incorrect sheet permissions or credential issues | Re-authenticate Google Sheets, check sheet sharing settings | | "Channel creation failed" | Invalid guild ID, category ID, or duplicate channel names | Verify Discord IDs, ensure unique entry IDs | | "Messages not sending" | Discord rate limiting or invalid channel references | Add delays between messages, verify channel creation success | | "Workflow execution failed" | Missing data fields or validation errors | Ensure all required fields are populated | ## 📊 Use Cases & Examples ### 1. Project Management Automation **Goal:** Streamline project channel creation process - Monitor new project requests or approvals - Create dedicated project workspaces - Notify relevant team members instantly - Track channel setup completion ### 2. Event Organization **Goal:** Organize events with dedicated Discord channels - Create channels for conferences, meetups, or workshops - Include event details in notifications - Tag organizers and participants - Maintain event communication history ### 3. Team Department Organization **Goal:** Manage department or team-specific channels - Separate channels for different departments - Share department announcements and updates - Coordinate team assignments - Track departmental activities ### 4. Community Management **Goal:** Organize community groups and special interest channels - Create channels for community groups - Share group information and guidelines - Facilitate member-to-member communication - Track community engagement and growth ## 📈 Performance & Limits ### Expected Performance | Metric | Value | |--------|-------| | Processing time | 30-60 seconds per entry | | Concurrent entries | 5-10 simultaneous (depends on Discord limits) | | Success rate | 95%+ for valid data | | Daily capacity | 100+ entries (depends on rate limits) | ### Resource Usage - **Memory:** ~50MB per execution - **Storage:** Minimal (data stored in Google Sheets) - **API calls:** 3-5 Discord calls + 2-3 Google Sheets calls per entry - **Execution time:** 1-2 minutes for complete process ## 📋 Quick Setup Checklist ### Before You Start - n8n instance running (self-hosted or cloud) - Google account with Sheets access - Discord server with admin permissions - Discord bot created and added to server - 15 minutes for complete setup ### Setup Steps - **Import Workflow** - Copy JSON and import to n8n - **Configure Discord** - Set up bot credentials and test - **Create Google Sheet** - New sheet with required columns - **Set up Google Sheets credentials** - OAuth setup and test - **Update workflow settings** - Replace IDs and credentials - **Test with sample entry** - Add test entry and verify - **Activate workflow** - Turn on monitoring trigger ## 🎉 Ready to Use! Your workflow URL: `https://your-n8n-instance.com/workflow/discord-channel-creation` 🎯 **Happy Channel Management!** This workflow provides a solid foundation for automated Discord channel creation. Customize it to fit your specific team needs and communication requirements.