Skip to content

[Feed problem] Reddit Feeds 403 Forbidden #8189

@untiedgames

Description

@untiedgames

Feed URL

https://old.reddit.com/r/worldnews.rss

Describe the problem

I'm running FreshRSS locally using xampp, just for personal use. I've been using it for a while now with Reddit feeds, using the old.reddit.com subdomain as suggested by some other troubleshooting posts. Occasionally, I will get a spate of 403 errors with all Reddit feeds, which can last anywhere from minutes to days. (Possibly until my IP refreshes or something changes on Reddit's end? This issue is so inconsistent that it temporarily resolved itself while I wrote this report.)

Last time this happened, I found that sending a custom useragent seemed to resolve the issue. Recently, I'm experiencing issues again. What's stumping me though is that while this issue is occurring, using curl and sending a custom useragent via the command line works fine, and I can download the RSS feed, indicating that I'm not rate-limited by IP or something. Running on the command line without a useragent or using FreshRSS with a useragent results in a 403. Is FreshRSS not properly sending the useragent? I have also ensured that I'm testing with the curl executable that FreshRSS is likely to be using (the one included with my xampp installation).

Example command which works via the command line:

curl -A "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:144.0) Gecko/20100101 Firefox/144.0" https://old.reddit.com/r/worldnews.rss > test.txt

Is there a way to see in detail what FreshRSS is doing with curl behind the scenes and identify what's going awry?

Log messages

cURL error 22: The requested URL returned error: 403 [https://old.reddit.com/r/worldnews.rss]

W3C Validator

Feed does not validate (but does function)

FreshRSS version

1.26.3

System information

  • Database version: 10.4.28-MariaDB
  • PHP version: 8.2.4
  • Installation type: Local installation via xampp
  • Web server type: Apache
  • Device: PC
  • OS: Windows 10
  • Browser: Firefox 144.0

Additional context

No response

Curl commands

curl -A "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:144.0) Gecko/20100101 Firefox/144.0" https://old.reddit.com/r/worldnews.rss > test.txt

User agents

Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:144.0) Gecko/20100101 Firefox/144.0

Metadata

Metadata

Assignees

No one assigned

    Labels

    Feed problem 🗞️Feeds that have issues while loading/reading in FreshRSS

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions