004 - HTML Scraping With Beautiful Soup Stream Our Mistakes podcast

8y ago

साझा करें

eddyizm and octon द्वारा प्रदान की गई सामग्री. एपिसोड, ग्राफिक्स और पॉडकास्ट विवरण सहित सभी पॉडकास्ट सामग्री eddyizm and octon या उनके पॉडकास्ट प्लेटफ़ॉर्म पार्टनर द्वारा सीधे अपलोड और प्रदान की जाती है। यदि आपको लगता है कि कोई आपकी अनुमति के बिना आपके कॉपीराइट किए गए कार्य का उपयोग कर रहा है, तो आप यहां बताई गई प्रक्रिया का पालन कर सकते हैं https://hi.player.fm/legal।

Stream Our Mistakes EP 004
In this episode, Matt walks us through html/web scraping using the popular python library, Beautiful Soup.
Here's the code snippet from the session and links:

 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47

# Created for Stream Our Mistakes  # https://streamourmistakes.blogspot.com/ # Reference: # https://docs.python.org/3/library/urllib.request.html # https://www.crummy.com/software/BeautifulSoup/bs4/doc/ from bs4 import BeautifulSoup import urllib.request '''  # local html to play with from documentation Uncomment to enable  html_doc = """ The Dormouse's story  The Dormouse's story Once upon a time there were three little sisters; and their names were Elsie, Lacie and Tillie; and they lived at the bottom of a well. ... """ ''' # Get the html from the web. f = urllib.request.urlopen('https://en.wikiquote.org/wiki/Aristotle') # Load the html into the parser. soup = BeautifulSoup(f.read(), 'html.parser') # Show the whole raw  # print(soup.prettify()) # Access a single element. # print(soup.title) # Find all a tags in the html doc and print some information. links = soup.find_all('a') for link in links: print(link.get('href')) print(len(links))

links:
https://docs.python.org/3/library/urllib.request.html
https://www.crummy.com/software/BeautifulSoup/bs4/doc/
Subscribe to the podcast on apple podcasts, google play, stitcher

matt
site: http://octon.io/
github: https://github.com/mmdempsey
eddyizm
site: http://eddyizm.com
twitter: http://twitter.com/eddyizm
github: https://github.com/eddyizm
perry
github: https://github.com/apk29
---
**youtube live broadcast:**
https://youtube.com/user/eddyizm/live
Subscribe to our channel and follow my twitter feed to be notified of our next live broadcast and feel free to leave us comments and suggestions on what you want to see.

5 एपिसोडस

# Created for Stream Our Mistakes # https://streamourmistakes.blogspot.com/ # Reference: # https://docs.python.org/3/library/urllib.request.html # https://www.crummy.com/software/BeautifulSoup/bs4/doc/ from bs4 import BeautifulSoup import urllib.request ''' # local html to play with from documentation Uncomment to enable html_doc = """ The Dormouse's story

The Dormouse's story

Once upon a time there were three little sisters; and their names were Elsie, Lacie and Tillie; and they lived at the bottom of a well.

...

""" ''' # Get the html from the web. f = urllib.request.urlopen('https://en.wikiquote.org/wiki/Aristotle') # Load the html into the parser. soup = BeautifulSoup(f.read(), 'html.parser') # Show the whole raw # print(soup.prettify()) # Access a single element. # print(soup.title) # Find all a tags in the html doc and print some information. links = soup.find_all('a') for link in links: print(link.get('href')) print(len(links))

पॉडकास्ट सुनने लायक

Stream Our Mistakes »
004 - HTML Scraping with Beautiful Soup