YOUTUBE DATA HARVESTING AND WAREHOUSING
YouTube Data Harvesting and Warehousing is a project that intends to provide users with the ability to access and analyse data from numerous YouTube channels. SQL, MongoDB, and Streamlit are used in the project to develop a user-friendly application that allows users to retrieve, save, and query YouTube channel and video data.
REQUIRED LIBRARIES:
(1) googleapiclient.discovery (2) streamlit (3) sqlite3 (4) pymongo (5) pandas
FEATURES:
The following functions are available in the YouTube Data Harvesting and Warehousing application:
Retrieval of channel and video data from YouTube using the YouTube API.
Storage of data in a MongoDB database as a data lake.
Migration of data from the data lake to a SQL database for efficient querying and analysis.
Search and retrieval of data from the SQL database using different options.