Thank you for taking the time to respond to my question and also for all the time and effort you put into building this amazing application. Up to this point I had only used straight Xpath scraping, so I wasn't sure if existing tools would work to parse the JavaScript code on the site.

Unfortunately, I don't possess the know-how to implement RegEx functionality into FreshRSS's scaping tools or a new tool within RSS-Bridge. I'll keep my eyes open for any future updates to FreshRSS that will allow me to build feeds off this kind of data.

@Alkarex,

I found another site that contains most of the upcoming event info I'm looking for from the same venue and this site appears to publish JSON for each individual event under <script type="application/ld+json">, although all attempts to scrape it using HTML + JSON or HTML + XPath return no results. Any thoughts what could be causing blockage here?

https://san-diego.events/venue/the-rady-shell-at-jacobs-park-events/

I'm scratching my head because simple XPath scraping should work on //li[@class="date-row"] or //ul[@class="dates-list"]/li Any pointers you can provide would be much appreciated.

I only ask again because being able to successfully build feeds from https://san-diego.events would unlock all of the upcoming event data I need for a couple missing venues and I'd like to build feeds for as many local spots as I can. With the newly released functionality for sorting by article date, my Local Events category will be even more useful.

@Alkarex You are a legend!! Thank you so much!

I will be able to test this out on my end later tonight. Do I just need to pull the freshrss:edge container to get the update? What version should I see reflected under Configuration > About > Version?

Thanks for the kind words :-)
#7369 is not yet merged in edge (needs some more testing). To test this branch, you can modify your Docker Compose like so:

  freshrss:
    image: freshrss/freshrss:7369
    build:
      context: https://github.com/Alkarex/FreshRSS.git#support-json-multiple-fragments
      dockerfile: Docker/Dockerfile
    ...

• https://github.com/FreshRSS/FreshRSS/blob/edge/Docker/freshrss/docker-compose.yml
• https://github.com/FreshRSS/FreshRSS/blob/edge/Docker/README.md#build-custom-docker-image

@Alkarex I spun up a new container and I can confirm that I'm able to build functional feeds off of the JSON fragments with this new version. Works like a charm!

I noticed in #7369 you mentioned this PR could cause breaking changes in existing XPath feeds. This new version didn't have any negative impact on my existing HTML + XPath feeds from what I could tell. After clearing articles and cache I was able to successfully reload all articles without issue from my most complex HTML + XPath 'upcoming event' feeds which use a couple operators to avoid pulling unwanted data from the site.

The only issue I ran into with this version was auth_openidc missing from the build, but I was able to roll back my auth config to web form for this test.

Please let me know if there's anything else I can test.

One last suggestion... I understand that sorting articles by article date vs published date is a new feature that was recently added to the application. One way this could be very handy is if users had the ability to configure the article sorting preference at the category level - Categories like Local News I would want organized by published date, but Local Events or Local Sports I would want to see listed by article date. Not sure if that's on the road map or not. I'm happy to open a feature request if needed.

this PR could cause breaking changes in existing XPath feeds

Only for the HTML+XPath+JSON mode

The only issue I ran into with this version was auth_openidc missing from the build

Ah, then replace by dockerfile: Docker/Dockerfile instead of the Alpine version