Building a Web Crawler using Python

In this article, I’m going to explain the concept of a web crawler, how search engines work, and guide you in building a simple Crawler bot. All the code I’ve written for this can be found on my GitHub repository, and feel free to use, modify, or replicate it for personal or commercial purposes without needing my consent. Project description Language: Python Libraries: request, bs4, regex, os, json IDE: Microsoft Visual Studio Code Project type: Web crawling/scraping Photo by Timothy Dykes on Unsplash ...

October 1, 2023 · 11 min · Elvin Zeynalli

Web Analytics: Analyzing clickstream of 160,000 visitors

Project description Language: Python Working file: Microsoft Visual Studio Code Project type: Web Analytics Companies receive traffic to their website from various resources. The more a company learns about the visitors’ traffic to its website, the better it understands the reasons behind their travel to the website. Besides the number of visitors to a website, it is important to learn from which sources those people arrive at the website. This can help the firms to see which external social account or network campaign is prone to bringing new customers. Furthermore, a company can also see the patterns in the behaviour of the visitors on different pages. By using various page analytics techniques, successful as well as problematic pages can be detected. ...

March 15, 2023 · 12 min · Elvin Zeynalli