Texts: Task 1 [40%]
Create a parser that extracts useful data from an Internet resource. The parser must collect data, structure it, and write it as a "your_parsed_data.json" file.
Hint: You can use libraries such as Selenium, BeautifulSoup, urlopen, or the Scrapy framework for Python.
Note: Please do not parse data from government (.gov) and bank (e.g., Kaspi Shop) websites. This is committing a crime.
Task 2 [10%]
Establish a connection from Python to a database. To do this, you need to connect Python to the database you created (preferred DBMS is PostgreSQL, but there are no restrictions). You can verify the connection to the database by using the following code:
cursor.execute("SELECT VERSION()");
Task 3 [50%]
Related to the previous task, it is necessary to implement several functions for interacting with the connected database.
- Displaying a list of tables in the connected database [5%]
- Displaying the schema of a selected table [5%]
- Displaying the contents of a selected table [5%]
- Functions to insert, change, and delete rows in a selected table [25%]
- Function to load content from a selected .json file to a selected table [10%]
Task 1 [40%]
Create a parser that extracts useful data from an Internet resource. The parser must collect data, structure it, and write it as a "your_parsed_data.json" file.
Hint: You can use libraries such as Selenium, BeautifulSoup, urlopen, or the Scrapy framework for Python.
Note: Please do not parse data from government (.gov) and bank (e.g., Kaspi Shop) websites. This is committing a crime.
Task 2 [10%]
Establish a connection from Python to a database. To do this, you need to connect Python to the database you created (preferred DBMS is PostgreSQL, but there are no restrictions). You can verify the connection to the database by using the following code:
cursor.execute("SELECT VERSION()");
Task 3 [50%]
Related to the previous task, it is necessary to implement several functions for interacting with the connected database.
- Displaying a list of tables in the connected database [5%]
- Displaying the schema of a selected table [5%]
- Displaying the contents of a selected table [5%]
- Functions to insert, change, and delete rows in a selected table [25%]
- Function to load content from a selected .json file to a selected table [10%]
Task 1 [40%]
Create a parser that extracts useful data from an Internet resource. The parser must collect data, structure it, and write it as a "your_parsed_data.json" file. Hint: You can use libraries such as Selenium, BeautifulSoup, urlopen, or the Scrapy framework for Python. Note: Please do not parse data from government (.gov) and bank (e.g., Kaspi Shop) websites. This is committing a crime.
Task 2 [10%]
Establish a connection from Python to a database. To do this, you need to connect Python to the database you created (preferred DBMS is PostgreSQL, but there are no restrictions). You can verify the connection to the database by using the following code:
cursor.execute("SELECT VERSION()");
Task 3 [50%]
Related to the previous task, it is necessary to implement several functions for interacting with the connected database.
- Displaying a list of tables in the connected database [5%]
- Displaying the schema of a selected table [5%]
- Displaying the contents of a selected table [5%]
- Functions to insert, change, and delete rows in a selected table [25%]
- Function to load content from a selected .json file to a selected table [10%]