Parsing prices of building materials
About project
Received database with prices. It is used to obtain current and historical data, price dynamics, to build a forecast of price changes.
It is necessary to collect data on the prices of building materials in hardware stores over a period of time.
A task
Bisiness effect
Implementation of a functionality that allows you to track prices for building materials
Solution
Technology
A platform for developing, delivering and running containerized applications. Docker is a tool that contains the libraries and programs needed to run and execute functions.
Python is the fastest growing programming language in the last few years. With the help of frameworks, libraries and extensions, you can implement price parsing.
These are libraries for developing, planning and monitoring workflows. Python code is used for development.
PostgreSQL is a popular database management system. PostgreSQL is based on the SQL language and supports many features.
Docker
Python
PostgreSQL
Airflow
These technologies have been used to develop this product. Аre agreed the plan and form of data storage. Price data were taken from several sites and an individual parser was developed for each site. For convenient display of data, all parsers are combined into one interface.
Project team
Nikolay D.
Developer
Alexander Kh.
Developer
Areas of use
This technology is used to collect information from the Internet in automatic mode. This will be useful for companies that need to track prices, product and service features.
