tech-trends

IBM Data Analytics Capstone Project - Technology Trends

In this project I took a role of a recently hired Data Analyst by a global IT and business consulting firm that is known for their expertise in IT solutions and their team of highly experienced IT consultants. In order to keep pace with changing technologies and remain competitive, the organization regularly analyzes data to help identify future skill requirements.

As a Data Analyst, I was tasked with collecting data from various sources and identifying trends for this year’s report on emerging skills.

First Task

Collect the top programming skills that are most in demand from various sources including:

Job postings
Training portals
Surveys

Second Task

Analyze the data and identify insights and trends that may include the following:

What are the top programming languages in demand?
What are the top database skills in demand?
What are the popular IDEs?

Step 1: Collecting Data

Collected and explored data for analysis using APIs and web scraping. Here are the Notebook links for this step:

Collecting data using API: https://github.com/essey1/tech-trends/blob/main/M0-Collecting_Jobs_data_Using_API-Questions.ipynb
Web scraping: https://github.com/essey1/tech-trends/blob/main/M1-Web-Scraping-Lab.ipynb
Exploring dataset: https://github.com/essey1/tech-trends/blob/main/M2-ExploreDataSet-lab.ipynb

Step 2: Data Wrangling

Wrangled data to remove duplicates, impute missing values and normalize the data.

Notebook link: https://github.com/essey1/tech-trends/blob/main/M3-DataWrangling-lab.ipynb

Step 3: Exploratory Analysis

Administered exploratory analysis to find the distribution, presence of outliers and correlation of the data.

Notebook link: https://github.com/essey1/tech-trends/blob/main/M4-ExploratoryDataAnalysis-lab.ipynb

Step 4: Data Visualization

Conducted SQL queries and generated various visualizations to showcase the data.

Notebook link: https://github.com/essey1/tech-trends/blob/main/M5-DataVisualization-lab.ipynb

Step 5: Dashboards

Generated dashboards using IBM Cognos Dashboard Embedded (CDE) to present the findings.

Dashboard link: https://eu-gb.dataplatform.cloud.ibm.com/dashboards/ce94cf0a-17e9-4240-9df9-a26353d04a0b/view/0262e22c00b609df67eaeee407cb2b047964735fb1bb835082877b495c627097f03c4694c826490888160235a0ea1a0c9a

Step 6: Final Presentation

Created a PowerPoint presentation to report the findings, implications and recommendations.

Powerpoint link: https://essey1.github.io/tech-trends/Essey_Araya_Presentation.pptx
PDF link: https://essey1.github.io/tech-trends/Essey_Araya_Presentation.pdf