BenjaminSchleier
Projects

PriceFeed

PriceFeed is a platform for monitoring and analyzing product prices in e-commerce. It brings price information from different sources together and makes price trends comparable over time.

Focus
Price tracking and market analysis
My role
A Codestep product
Type
SaaS platform
Coverage
Price data from different e-commerce sources
Data basis
Millions of products
Technology
Own web crawlers; cloud architecture with caching and load balancing
Website von PriceFeed

In brief

Dashboards show price histories and trends, and notifications report price changes in real time. Behind them run PriceFeed's own crawlers, which cover millions of products. Keeping the data accurate and the sources in working order is a large part of the technical work.

The story

PriceFeed is a software product for monitoring prices in e-commerce. The goal is to bring together price data from different sources and make changes over time visible. Retailers can use that information to see where their prices stand in their market.

The technical challenge lies in capturing data reliably from many different websites and bringing it into one consistent format. For this we developed our own crawlers and methods for processing price data. Sources can change their structure and availability, which is why ongoing monitoring and maintenance matter.

The analyzed data is made available through dashboards. Filters, timelines and notifications help users spot changes in the market. When a tracked price changes, PriceFeed reports it in real time.

  • Price tracking in e-commerce
  • Trend analysis and market forecasts
  • Competitor price comparisons
  • Dashboards with historical data
  • Real-time notifications
QuellenCrawlerAbgleichDashboard

What is behind it

  • Following price trends

    The platform brings together price information from different sources and makes changes over time visible.

  • In-house crawlers

    The crawlers cover millions of products. When a source changes its structure, they have to be adjusted.

  • Dashboards and notifications

    Users look at historical data and follow price changes according to their own settings.

Challenges

  • Consistent, accurate data

    ChallengePrice data from many sources has to be correct, even when the market moves often.

    SolutionAlgorithms synchronize and check the data from the various sources.

  • Scalability and performance

    ChallengeLarge volumes of data and many requests, with no loss of speed.

    SolutionA cloud architecture with caching and load balancing.

  • Crawlers and data acquisition

    ChallengePrice data comes from websites with different structures and access conditions.

    SolutionData collection uses our own crawlers and suitable interfaces. Availability, technical limits and legal requirements have to be considered for each source.

  • Every user needs a different view

    ChallengeA broad user base needs a different slice of the data in each case.

    SolutionIn the dashboard and the notification system, users filter the data and set their own preferences.

Milestones

  • Data infrastructure

    It delivers updates in real time and grows with the number of sources and users.

  • Analysis features

    Trend analysis, price comparisons and market forecasts for companies that watch competitor prices.

Results

  • A basis for pricing decisions

    Price histories and comparisons can support companies when they decide on prices.

  • Data in one place

    Checked price data from numerous sources sits in a single platform.