I’m trying to create a news fetcher which fetches the top news from many different countries around the world from many different sites in python.

I did this before using web scraping bbc, sky news, amazes etc using beautifulsoup and traversing html trees

There are apis such as News api online for this use but id like to create my own so I can customise it. I can either manually webscrape or use RSS but RSS doesn’t give me the top news from different countries. I’d like to have the api return the body, image and title of the article. The title isn’t too hard but fetching the body and image can be.

My question is what’s the best way to go about this and how do apis such as news api perform this without manually web scraping

Apologies if it’s a dumb question I’m trying to come up with a solution for my project as well

Thank you for any help