servicesdata-collection

rudiscuss your taskmenuclose

Custom web scraping: data from websites, feeds, and chats

The data you need is scattered across websites, feeds, open groups, and chats, and someone collects it by hand. I set things up so that it arrives by itself where it is needed: in a spreadsheet, a channel, or a bot.

  • Setup from $200 3–10 days
  • After that from $50/mo

What it gives you

Data arrives by itself and on schedule, not whenever someone gets around to it. Repeats are filtered out before they reach you, and a failure of one source does not stop the rest.

What is included

  • Sources: websites, feeds, open groups, and chats.
  • Delivery: to a spreadsheet, a channel, or a bot, wherever people work with the data.
  • Filtering out repeats: the same item from different sources is recognized as one, including across different languages.
  • Keeps working when a source fails: if one source does not respond, the rest keep working. For important data, a backup source can be set up.
  • Running on schedule: collection runs on a server by itself, on weekends, at night, and during vacations.
  • Monitoring is in the monthly fee: a scheduled check that collection has not gone quiet.

Price and timeline

The price range runs from a simple version to a complex one. I name the exact price after a review, before work starts, and it does not go up without your consent. Timelines are in business days, counted from when I receive the deposit and the materials.

Price and timeline: Custom web scraping: data from websites, feeds, and chats
ServicePrice, $Timeline, days
Data collection200–500+ 50–150/mo3–10

Prices for everything else are in the approximate price list.

How to pay

Deposit
50%
Orders from $700
in stages: 40 / 30 / 30
Maintenance
a month in advance
Minimum order
$100
Two rounds of edits
included

Prices are in dollars. You can pay in baht, dong, or rubles at the exchange rate on the invoice date. Hourly pricing applies only where the scope can’t be known in advance: repairs and changes to someone else’s code.

How the work goes

  1. Review

    I look at what you have now and where you’re losing time or customers, and I tell you what can be done about it. You don’t have to decide anything before this conversation.

  2. Plan

    One page: what I do, what is not included, and what I need from you. This is also where the scope and the price become clear.

  3. Build

    I work in stages and show you the result of each one, not everything at once on delivery day.

  4. Check

    Before delivery, I run everything on your real data: prices, scenarios, errors.

  5. Handover

    I hand over everything: the code, access, and instructions. Then you choose a format: take it all yourself or leave the maintenance to me.

How it looks in practice

The morning digest in the group: weather, air quality, exchange rates, and prices

A Telegram group that fills itself: 474 posts in half a year, and not one of them posted by a person

A topic-based group fades because of irregular posting, not bad content: the owner runs out of time, and a social media manager costs money and leaves. Here the feed goes out on schedule by itself: weather and exchange rates, news in Russian from English-language sources, a Vietnamese lesson. Repeats are filtered out by three checks, and a separate watchdog reports if a section goes quiet.

Group bot in Da Nang

A post in the channel in the “Article” format: image and text in one message

A psychologist’s channel that fills itself: 196 posts in five months

An expert runs a channel personally for as long as the energy lasts, and then the feed goes quiet. Here posts go out twice a day with no one involved: the topic from the plan, the article from one of 31 sources, the text in the specialist’s voice. The main work is not the publishing itself but the checks: what will stop the bot if it is about to publish a repeat, text planted by someone else’s website, or its own internal notes.

Psychologist’s channel bot

What people ask about this service

What happens if a source breaks or changes its page layout?

The other sources will keep working: a failure of one does not stop the collection. Where the data matters, a backup source can be set up. And so that a failure does not go unnoticed, monitoring is included in the monthly fee.

How are repeats filtered out?

The same item from different sources is recognized as one: by its address, by a similar headline, and by matching numbers and names, even if the sources are in different languages.

Where does the data go?

Wherever people work with it: a spreadsheet, a channel, or a bot. If the data needs to be not just collected but rewritten for readers and published, then it is a self-filling channel.

Need something similar?

Whether it’s a website, a bot, or something that is now done by hand, tell me what’s going on, and I’ll tell you whether it can be solved or not.

I have your request

I’ll read it myself and reply where you told me to.

Send another one

What you need you can pick several

In your own words: what you have now and what you want to get. If you have a website or a bot, paste the link.

Your request will come to me on Telegram, and I’ll reply myself.

If it’s easier, contact me directly: on Telegram, on WhatsApp, or by email.

Not sure what’s wrong with your website? Check it for free on Telegram: @jw_site_check_bot.

Who owns everything afterward and what happens if I disappear: answers on the home page.