The Website Scraper automation allows you to extract data from websites for various purposes such as lead generation, market research, or competitor analysis. This tool is especially useful for founders, sales managers, marketers, and growth hackers looking to automate the collection of valuable information at scale. TexAu supports bulk data input, scheduling, and export to Google Sheets or CSV, with the flexibility to run the automation on the cloud or desktop.

Step 1: Log in to the TexAu App and Locate the Automation

Log in to your TexAu account at v2-prod.texau.com. Navigate to the Automation Store and search for "Website Scraper." Select this tool to configure it for your scraping requirements.

{% custom-image src="https://v2-web-assets.s3.us-east-1.amazonaws.com/Automations/website-scraper/website-scraper.png" alt="search-for-the-particular-website-automation" /%}

Step 2: Define Your Target Websites

Single Input

Use this option to scrape website data from a single website.

• Website URL: Enter the website URL directly into the provided field (e.g., https://www.texau.com).
• Scrape About Us Page (Optional): Enable this option to extract data from the website’s About Us page.
• Scrape Blog Page (Optional): Enable this option to extract data from the website’s Blog page.
• Account (Optional): Integrate third-party APIs like Rocket Scrape or Scrape AI to enhance the scraping process and extract additional website data as per your need.

{% custom-image src="https://v2-web-assets.s3.us-east-1.amazonaws.com/Automations/website-scraper/website-scraper-single-inputs.png" alt="enter-a-single-input" /%}

Google Sheets

This option is ideal for running bulk queries efficiently using Google Sheets.

Connect your Google account

Click Select Google Account to choose your connected account, or click Add New Google Sheet Account and follow the instructions to authorize access if no account is linked.

Select your spreadsheet

• Click Open Google Drive to locate the Google Sheet containing your website URLs.
• Select the spreadsheet and the specific sheet where your data is stored.

Adjust processing options

• Number of Rows to Process (Optional): Define how many rows of the sheet should be scraped.
• Number of Rows to Skip (Optional): Specify rows to skip if necessary.

Provide input details

• Website URL: Ensure the correct column contains the website URLs for scraping.
• Scrape About Us Page (Optional): Enable this option to extract data from the About Us page.
• Scrape Blog Page (Optional): Enable this option to extract data from the Blog page.
• Account (Optional): Integrate third-party APIs like Rocket Scrape or Scrape AI to enhance the scraping process and extract additional website data as per your need.

{% cta buttonText="Start free trial" title="Scrape Website Data Tailored to Your Needs" description="Use TexAu’s Website Scraper to extract text, images, and links for research, competitor analysis, or content aggregation no coding required." /%}

Watch Row (Optional)

With Watch Row, automation is executed when new data is added to a Google Sheet. This feature eliminates manual tracking and keeps processes running smoothly.

To configure, choose a scan frequency and set the start and end dates.

Watch Row Schedule:

• None
• At Regular Intervals (e.g., every 15 minutes or every hour)
• Once
• Every Day
• On Specific Days of the Week (e.g., every Wednesday and Sunday)
• On Specific Days of the Month (e.g., the 2nd and 19th)
• On Specific Dates (e.g., July 12)

The system checks for updates every 15 minutes and stops after five days, unless adjusted.

{% custom-image src="https://v2-web-assets.s3.us-east-1.amazonaws.com/Automations/website-scraper/website-scraper-google-sheet.jpeg" alt="use-google-sheets-for-bulk-input" /%}

Process a CSV File

This option allows you to extract website data from a static CSV file.

• Upload the file by selecting the CSV file containing website URLs from your computer. Verify its content using the provided preview.
• Adjust processing settings by defining the number of rows to process or skip, if required.
• Provide input details by ensuring the correct column contains the website URLs for scraping. Enable options to scrape the About Us and Blog pages, as needed.

Step 3: Execute Automations on TexAu Desktop or Cloud

• Open the automation setup and select Desktop Mode.
• Click Choose a Desktop to Run this Automation.
• From the platform, select your connected desktop (status will show as "Connected") or choose a different desktop mode or account.
• Click “Use This” after selecting the desktop to run the automation on your local system.
• Alternatively, if you wish to run the automation on the cloud, click Run directly without selecting a desktop.

{% custom-image src="https://v2-web-assets.s3.us-east-1.amazonaws.com/Common/cloud-or-desktop-execution/cloud-or-desktop-execution.png" alt="choose-cloud-or-desktop-execution" /%}

Step 4: Schedule the Automation (Optional)

Set up a schedule to run the scraper at specific times or intervals. Click Schedule to configure the timing and recurrence options:

• None
• At Regular Intervals (e.g., every 6 hours)
• Once
• Every Day
• On Specific Days of the Week (e.g., Mondays and Fridays)
• On Specific Days of the Month (e.g., the 1st and 15th)
• On Specific Dates (e.g., March 15)

Tip: Scheduling is ideal for keeping scraped data updated regularly for dynamic use cases like market research.

{% custom-image src="https://v2-web-assets.s3.us-east-1.amazonaws.com/Common/schedule-the-automation/schedule-the-automation.png" alt="schedule-the-automation" /%}

Step 5: Set an Iteration Delay (Optional)

Avoid detection and simulate human-like activity by setting an iteration delay. Choose minimum and maximum time intervals to add randomness between actions. This makes your activity look natural and reduces the chance of being flagged.

• Minimum Delay: Enter the shortest interval (e.g., 10 seconds).
• Maximum Delay: Enter the longest interval (e.g., 20 seconds).

Tip: Random delays keep your automation safe and reliable.

{% custom-image src="https://v2-web-assets.s3.us-east-1.amazonaws.com/Common/iteration-delay/iteration-delay.png" alt="iteration-delay" /%}

Step 6: Choose Your Output Mode (Optional)

Choose how to save and manage the extracted alumni data. TexAu provides the following options:

• Append (Default): Adds new results to the end of existing data, merging them into a single CSV file.
• Split: Saves new results as separate CSV files for each automation run.
• Overwrite: Replaces previous data with the latest results.
• Duplicate Management: Enable Deduplicate (Default) to remove duplicate rows.

Tip: Google Sheets export makes it easy to collaborate with your team in real time, particularly useful for alumni network management and analysis.

{% custom-image src="https://v2-web-assets.s3.us-east-1.amazonaws.com/Common/output-mode/output-mode.png" alt="output-mode" /%}

Step 7: Access the Data from the Data Store

Once the scraping process is complete, navigate to the Data Store section in TexAu to view the extracted data. Locate the "Website Scraper" automation and click See Data to review or download the results.

{% custom-image src="https://v2-web-assets.s3.us-east-1.amazonaws.com/Automations/LinkedIn+Job+Scraper/data-store-see-data.png" alt="Website Scraper" /%}

The Website Scraper automation simplifies the process of extracting valuable information from websites, making it an indispensable tool for lead generation, research, and analysis. With customizable scheduling, flexible input options, and seamless data export capabilities, TexAu empowers professionals to scale their workflows efficiently and achieve actionable insights.