Release V0.3

External Project Contribution

Background Knowledge

On October 19th 2020, during my Release v0.2, I worked on a web scraper. Web scraping is extracting data from websites, such as Google. While I was browsing on Github, I found this issue. I have used web data extraction before when I was harvesting urls for a website. The repository owner for that weeks project, was looking to purchase some weights for at home workouts during quarantine. The repository owner wanted a notification sent to his personal email when the scraper found weights in his price range. You can check out the implementation of SendGrid here. 

This week, I thought it would be cool to try and implement a web scraper myself! I found this issue while browsing on Github called realpython/python-scripts. I always thought these repositories were about getting a commit into a repository for Hackoctober Fest, also known as cheating. It turns out these repositories are actually pretty cool! The owner of the repository created an issue saying it would be nice to have a script that scrapes all the events from the list of Hackoctober events, and store them in a CSV file. I thought this would be a great challenge to test my abilities in Python. 

During this Pull Request, I got some exposure to the library called Pandas. Pandas is a software library for data manipulation. Although I didn’t get to work with Pandas very much, I got to use DataFrames one of the methods that this library includes. BeautifulSoup is another library that I had the pleasure to gain experience with. BeautifulSoup is a package for parsing HTML documents and allows you to find HTML attributes efficiently. With the use of BeautifulSoup, I was able to find the HTML elements that I wanted to manipulate rather than waste time parsing any other text that I did not want. I simply was able to append this data to a list, that I would later use to create my comma separated value list.

 




Comments

Post a Comment

Popular posts from this blog

Working with others

     This week our course was given the task of creating a cli command, which included our code being reviewed by one of my classmates. Initially, this gave me some anxiety as sharing my work with others is not my strongest suit. Nonetheless, I created a post asking if anyone was looking for a partner and Michael Appeared.      It turns out that having someone look over my work was much less scary than I had initially anticipated. Working with Michael was actually fun, and having the opportunity to look over someone else's work was a great learning experience for me.       With another pair of eyes looking at my code, Michael noticed errors and instructions that I was not addressing. Some instructions I had forgot to mention include the fact that my program requires bash. It did not occur to me that most of us live in a Windows Operating System. Another missing component was my Blog link in my READme. I had forgotten to include a link to my blog! As soon as Michael notified me he w
Read more

Release V0.3 Part 2

Internal Project Contribution In the past and currently, I have worked on several issues within the Telescope community. At first I was worried about understanding other peoples code. However, after looking at a few issues and spending some time on Telescopes repository, I noticed that I could contribute to some of the issues that our community was facing. In total, I worked on three different issues all ranging from different skill levels, the easiest being the documentation update. You can check out the changes that were implemented here . In order to update the documentation, I had to read up on all the different types of logging. I excluded the unnecessary information from Telescopes documentation to accentuate the important details about how to implement the logger. The documentation update got merged fairly quickly, this gave me a sense of relief since I was worried that I would not be able to get a commit in before the due date. Completing the required pull requests for Rel
Read more

Paving the Way

Sorry my blog hasn't been updating recently, Im so busy getting ready to get in the groove back at home. Im not going to lie the vacation life is great! Waking up at 3pm, taking baths, and the food is ready when I sit down at the table. It's a privilege I take for granted.  Since writing a blog post helps me take a minute to reflect on the experiences I have been going through, I will keep making these blog posts. In addition, I noticed these blog posts encourage me to acknowledge the accomplishments of today, keep me focused on the progress I am making, and finally.. I must work on articulating sentences. Here is a visualization of myself:  An update on what I have been doing. I moved back home for Christmas, I started working on my pool hall app, and Ive been applying to positions. With Christmas break upon us I would like to get some personal projects going. This will give me the opportunity to solidify my knowledge of what I have learned so far. I started working on this po
Read more