{"id":28518,"date":"2024-03-18T11:05:10","date_gmt":"2024-03-18T05:35:10","guid":{"rendered":"https:\/\/codeforgeek.com\/?p=28518"},"modified":"2024-03-18T11:05:11","modified_gmt":"2024-03-18T05:35:11","slug":"wikipedia-module-in-python","status":"publish","type":"post","link":"https:\/\/codeforgeek.com\/wikipedia-module-in-python\/","title":{"rendered":"Wikipedia Module in Python: An In-Depth Guide"},"content":{"rendered":"\n

Welcome to a new tutorial, here we will learn about the Wikipedia Module in Python. We will see how we can achieve Data scraping<\/strong> using the Wikipedia API. Data scraping is the automated extraction of information from websites or other sources on the internet. Let’s see how we can use the most informative site on the internet i.e. Wikipedia in our Python applications. <\/p>\n\n\n\n

An Introduction to Wikipedia Module in Python<\/h2>\n\n\n\n

Wikipedia is a big online encyclopedia where people can work together to write and edit articles on many subjects. It’s a widely used reference site available in multiple languages. Wikipedia API is a Python tool that makes it easy to work with Wikipedia using code. It helps you find articles, get content and summaries, and access different details about Wikipedia entries. This tool lets you include Wikipedia information in your Python programs for various uses. Let’s learn about its installation and import.<\/p>\n\n\n\n

Installation Statement<\/h3>\n\n\n\n

To get data from Wikipedia, start by installing the Wikipedia library. It wraps up the official Wikipedia API. Use the command below in your command prompt or terminal to install it:<\/p>\n\n\n

\npip install wikipedia\n<\/pre><\/div>\n\n\n
\"Installation\"<\/figure>\n\n\n\n
After installing, we can utilize the Wikipedia API in Python to gather information from Wikipedia. To access the methods of the Wikipedia module, simply import it using the following command:<\/p>\n\n\n
\nimport wikipedia\n<\/pre><\/div>\n\n\n
Getting Started with Wikipedia Module<\/h2>\n\n\n\n
Let’s now look at different use cases of what we can do using this Wikipedia module.<\/p>\n\n\n\n
Getting Wikipedia Articles Summary <\/h3>\n\n\n\n
Now, we will see how to use the Wikipedia module in Python. Let’s start with the basics. We can use the summary()<\/strong> method to extract a Wikipedia article’s summary in Python. We provide the article title as a parameter to this method, and it returns a specified number of sentences for the given title. To limit the stored data, you can include the desired number of sentences as a parameter, as shown in the following code.<\/p>\n\n\n\n
Example:<\/strong><\/p>\n\n\n
\nimport wikipedia\n\nTitle = "A. P. J. Abdul Kalam"\n\n# Extract the summary with a specified number of sentences\nSummary = wikipedia.summary(Title, sentences=5)\nprint("According to wikipedia : ")\nprint(Summary)\n\n<\/pre><\/div>\n\n\n
Output:<\/strong><\/p>\n\n\n\n
\"Summary\"
Summary of the given title<\/figcaption><\/figure>\n\n\n\n
The summary for the given title will be printed in a specified number of sentences i.e. 5.<\/p>\n\n\n\n
However, it is very important to note that the title provided must match the exact wording of the Wikipedia page’s title. If not, it will throw a disambiguation error<\/strong>, which means that the page does not exist. For example, if the title were:<\/p>\n\n\n
\nTitle = "Dr APJ Abdul Kalam"\n<\/pre><\/div>\n\n\n
\"Summary<\/figure>\n\n\n\n
The output will display a disambiguation error and say that the given title does not match any pages.<\/p>\n\n\n\n
If there are many different articles with different meanings for the same title word, for example, ‘com<\/strong>,’ where the page is disambiguated, it will show a disambiguation error.<\/p>\n\n\n
\nTitle = "com"\n<\/pre><\/div>\n\n\n
\"Summary<\/figure>\n\n\n\n
Many results match the title ‘com’. Suppose we want to summarize ‘Center of mass’, then, we need to specify it in the title to get accurate results, like:<\/p>\n\n\n
\nTitle = "Center of mass"\n<\/pre><\/div>\n\n\n
\"Summary<\/figure>\n\n\n\n
Now, with a more specific query, the output displays the accurate summary.<\/p>\n\n\n\n
Customizing the Page Language<\/h3>\n\n\n\n
The set_lang<\/strong> function in the Python Wikipedia module is used to choose the language for future queries. You can specify the Wikipedia edition’s language from which you want to get information.<\/p>\n\n\n\n
Example:<\/strong><\/p>\n\n\n
\nimport wikipedia\n# Set the language to Hindi\nwikipedia.set_lang("hi")\n\nSummary = wikipedia.summary("Tiger")\nprint("According to wikipedia : ")\nprint(Summary)\n\n<\/pre><\/div>\n\n\n
Output:<\/strong><\/p>\n\n\n\n
\"Set<\/figure>\n\n\n\n
In this example, using wikipedia.set_lang(“hi”)<\/strong> sets the language to Hindi. Afterwards, any queries with the Wikipedia module will get information from the Hindi edition. The summary<\/strong> function is then used to fetch a summary for the Hindi Wikipedia page titled “Tiger.”<\/p>\n\n\n\n
Getting Wikipedia Page Data<\/h3>\n\n\n\n
We utilize the page<\/strong> function to obtain an entire Wikipedia page by providing the page title as a parameter. To extract specific information from the page object, we specify the exact details needed. The page<\/strong> function enables us to retrieve contents, categories, coordinates, images, links, and other metadata from a Wikipedia page. Let’s see the use of each page object one by one.<\/p>\n\n\n\n
1) .content<\/h4>\n\n\n\n
When we use the page<\/strong> function, we retrieve the main content of a Wikipedia page using the .content<\/strong> attribute. Keep in mind that this content may include not only the main text but also sections, references, and other information from the page.<\/p>\n\n\n\n
Example:<\/strong><\/p>\n\n\n
\nimport wikipedia\n\nTitle = "William Shakespeare"\n\nContent = wikipedia.page(Title).content\nprint("According to wikipedia : ")\nprint(Content)\n\n<\/pre><\/div>\n\n\n
Output<\/strong>:<\/p>\n\n\n\n
\"Content\"<\/figure>\n\n\n\n
2) .url<\/h4>\n\n\n\n
If you wish to obtain the URL of the given page, you can use the .url<\/strong> attribute to fetch and display it.<\/p>\n\n\n\n
Example:<\/strong><\/p>\n\n\n
\nimport wikipedia\n\nTitle = "Walt Disney World"\n\nURL = wikipedia.page(Title).url\nprint("According to wikipedia : ")\nprint(URL)\n\n<\/pre><\/div>\n\n\n
Output:<\/strong><\/p>\n\n\n\n
\"URL\"<\/figure>\n\n\n\n
3) .references<\/h4>\n\n\n\n
When we use the page function, employing the .references <\/strong>attribute is intended to retrieve the reference links or citations from a Wikipedia page.<\/p>\n\n\n\n
Example:<\/strong><\/p>\n\n\n
\nimport wikipedia\n\nTitle = "International Women's Day"\n\nReferences = wikipedia.page(Title).references\nprint("According to wikipedia : ")\nprint(References)\n\n<\/pre><\/div>\n\n\n
Output:<\/strong><\/p>\n\n\n\n
\"References\"<\/figure>\n\n\n\n
In this example, you have a list of URLs or identifiers representing the references or citations from the Wikipedia page for “International Women’s Day.” This information is helpful if you want to analyze or display the sources used in creating the Wikipedia page content.<\/p>\n\n\n\n
4) .links<\/h4>\n\n\n\n
The .links<\/strong> attribute is used to retrieve a list of links present on a Wikipedia page.<\/p>\n\n\n\n
Example:<\/strong><\/p>\n\n\n
\nimport wikipedia\n\nTitle = "Santorini"\n\nConnected_links = wikipedia.page(Title).links\nprint("According to wikipedia : ")\nprint(Connected_links)\n\n<\/pre><\/div>\n\n\n
Output:<\/strong><\/p>\n\n\n\n
\"Links\"<\/figure>\n\n\n\n
In this example, using wikipedia.page(Title).links<\/strong> gives you a list of links from the Wikipedia page for “Santorini.” Each element in the list represents a link found on the page. This information is helpful if you want to extract and analyze the links within the Wikipedia page or explore related topics. Note that the list may include different types of links, like internal links to other Wikipedia pages, external links, and references.<\/p>\n\n\n\n
5) .categories<\/h4>\n\n\n\n
The .categories<\/strong> attribute is used to get a list of categories to which a Wikipedia page belongs.<\/p>\n\n\n\n
Example:<\/strong><\/p>\n\n\n
\nimport wikipedia\n\nTitle = "Hill Forts of Rajasthan"\n\nBelonged_categories = wikipedia.page(Title).categories\nprint("According to wikipedia : ")\nprint(Belonged_categories)\n\n<\/pre><\/div>\n\n\n
Output:<\/strong><\/p>\n\n\n\n
\"Categories\"<\/figure>\n\n\n\n
In this example, using wikipedia.page(Title).categories<\/strong> gives you a list of categories related to the Wikipedia page for “Hill Forts of Rajasthan.” Each element in the list represents a category to which the page belongs. This is useful if you want to categorize Wikipedia pages based on their topics. Remember, the list of categories reflects how the Wikipedia community has organized and tagged the page’s content.<\/p>\n\n\n\n
Getting a Random Wikipedia Page<\/h3>\n\n\n\n
The random<\/strong> method in Python’s Wikipedia module is used to get a random Wikipedia page. When you use wikipedia.random()<\/strong>, it gives you the title of a randomly chosen Wikipedia page, letting you explore various topics.<\/p>\n\n\n\n
Example:<\/strong><\/p>\n\n\n
\nimport wikipedia\n\nRandom = wikipedia.random()\n\nTitle = wikipedia.page(Random).title\nSummary = wikipedia.summary(Random)\nprint("According to wikipedia : ")\nprint(Title)\nprint(Summary)\n\n<\/pre><\/div>\n\n\n
The code randomly selects a Wikipedia page title using the wikipedia<\/strong> module, retrieves the title and a summary of the corresponding Wikipedia page, and prints this information to the console. It provides a quick way to explore diverse topics from Wikipedia.<\/p>\n\n\n\n
Output:<\/strong><\/p>\n\n\n\n
\"Random\"<\/figure>\n\n\n\n
The above result shows that the program has randomly selected the topic “Stielgranate 41<\/strong>” and has displayed the summary for the same.<\/p>\n\n\n\n
Getting a List of Titles<\/h3>\n\n\n\n
The search<\/strong> method in Python’s Wikipedia module is used for searching on Wikipedia and getting a list of titles that match the query. It helps find Wikipedia pages related to a specific topic.<\/p>\n\n\n\n
Example:<\/strong><\/p>\n\n\n
\nimport wikipedia\n\nQuery = wikipedia.search("Rajasthan")\n\nprint("Search results:")\nfor result in Query:\n    print(result)\n\n<\/pre><\/div>\n\n\n
Output:<\/strong><\/p>\n\n\n\n
\"Search\"<\/figure>\n\n\n\n
In this example, using wikipedia.search(“Rajasthan”)<\/strong> gives a list of Wikipedia page titles related to “Rajasthan.” This is helpful when you want to find relevant Wikipedia pages on a specific topic. The obtained titles can then be used to get more detailed information about the corresponding pages.<\/p>\n\n\n\n
Conclusion<\/h2>\n\n\n\n
And here we are at the end of this article. I hope that you are clear about the role of Wikipedia module in Python programming. Now you can confirm your understanding of the Wikipedia module by using it in your programs. <\/p>\n\n\n\n
If you enjoyed reading this, be sure to check out some of our other articles –<\/em><\/p>\n\n\n\n