summaryrefslogtreecommitdiff
path: root/classes/rssutils.php
AgeCommit message (Collapse)Author
2020-10-01hide uninteresting errors in several DOMDocument->loadHTML() invocationsAndrew Dolgov
2020-09-30add DAEMON_UNSUCCESSFUL_DAYS_LIMIT tunable (defaults to 30 days)Andrew Dolgov
2020-09-30set ttrss_feeds.last_successful_update as neededAndrew Dolgov
2020-09-29housekeeping: add task to cleanup orphan feed iconsAndrew Dolgov
2020-09-29Logger::log - allow specifying errnoAndrew Dolgov
bump severity of PDO exception log messages to E_USER_WARNING
2020-09-28update_rss_feed: fallback to previous method if passthru() is not availableAndrew Dolgov
2020-09-28accept -1 as a valid exit code for per-feed update processesAndrew Dolgov
2020-09-28don't mention last_updated in non-zero failure error message because that's ↵Andrew Dolgov
not what it means
2020-09-28improve logging for per-feed update task failuresAndrew Dolgov
2020-09-27update_rss_feed: don't return as if failed on http 304Andrew Dolgov
2020-09-27update-feed: exit with non-zero exit code if update_rss_feed() failedAndrew Dolgov
daemon: log if per-feed update task terminated with non-zero exit code
2020-09-27lock per-feed update processes based on feed ID to reduce possibiltyAndrew Dolgov
of concurrent updates
2020-09-27update individual feed in a separate process to prevent PHP fatal errorsAndrew Dolgov
(for example, OOM) from stopping the entire batch this should also slightly increase memory budget for update processes
2020-09-22fix updater never scheduling feeds for update if they never been updated ↵Andrew Dolgov
before while having default update interval set
2020-09-22use self:: in some places to invoke static methods from the same classAndrew Dolgov
2020-09-22remove a lot of stuff from global context (functions.php), add a few helper ↵Andrew Dolgov
classes instead
2020-09-21clarify some URL validation-related error messagesAndrew Dolgov
2020-09-21update_rss_feed: log effective URL after fetchingAndrew Dolgov
validate_url: treat scheme as case-insensitive
2020-09-17replace FALSE with false so that static analyzer shuts up about itAndrew Dolgov
2020-09-17don't try to update manually disabled feeds even if they haven't been ↵Andrew Dolgov
updated before or are marked for a manual update
2020-06-24core: pass found enclosures to HOOK_ARTICLE_FILTERAndrew Dolgov
af_redditimgur: remove enclosures if we found something to embed because it's going to be a low-res thumbnail
2020-06-15better support for image srcset attributes as discussed in ↵Andrew Dolgov
https://community.tt-rss.org/t/problem-with-img-srcset/3519
2020-05-17calculate_article_hash: don't die() on previous, woopsAndrew Dolgov
2020-05-17calculate_article_hash: ignore some useless or read-only fields (i.e. GUID) ↵Andrew Dolgov
when calculating hash
2020-05-17* store UID in article hashed GUID separately so it could be migrated ↵Andrew Dolgov
cleanly to a different instance * store resulting GUID as a JSON object so it could be extended easier if needed
2020-04-29DiskCache: properly deal with srcset attributesAndrew Dolgov
2020-04-29remove unneeded var_dump()Andrew Dolgov
2020-04-29* add HOOK_ENCLOSURE_IMPORTEDAndrew Dolgov
* pass feed id to HOOK_FEED_PARSED
2020-03-12add support for video[@src] in media cachelllusion3418
it's a valid alternative to a source[@src] child element: https://developer.mozilla.org/en-US/docs/Web/HTML/Element/video
2020-03-12actually download <video> posters to media cachelllusion3418
video[@poster] is already supported in the rewriting logic but never actually downloaded
2020-02-28add validationtextarea control, use it for filter match editorAndrew Dolgov
2020-01-24scrap counter cache system; rework counters to sum() booleans insteadAndrew Dolgov
2019-11-25cache media: set referrer to source URL when fetching imagesAndrew Dolgov
2019-11-20tag-related fixesAndrew Dolgov
1. move tag sanitization to feedparser common item class 2. enforce length limit on tags when parsing 3. support multiple tags passed via one dc:subject and other such elements, parse them as a comma-separated list 4. sort resulting tag list to prevent different order between feed updates 5. remove some duplicate code related to tag validation 6. allow + symbol in tags
2019-11-17reset domain hit quota on feed update startAndrew Dolgov
2019-11-14update_rss_feed: add specific logging for HOOK_FETCH_FEED, ↵Andrew Dolgov
HOOK_FEED_FETCHED, HOOK_FEED_PARSED handlers
2019-11-12is_gzipped: don't try to strpos() over entire bufferAndrew Dolgov
2019-10-25allow article filters to modify num_commentsAndrew Dolgov
2019-09-30update_rss_feed: force cast initial timestamp value to integerAndrew Dolgov
2019-09-11rework previous to pass unformatted timestamp to plugin, and deal with ↵Andrew Dolgov
formatting later also, move timestamp-related debugging output after plugin handler
2019-09-11pass formatted entry timestamp to article filters and allow them to modify itAndrew Dolgov
2019-08-14retire MIN_CACHE_FILE_SIZEAndrew Dolgov
2019-08-14RSSUtils::cache_media, cache_enclosures: use DiskCacheAndrew Dolgov
2019-08-13* HOOK_ENCLOSURE_ENTRY: pass article_id to handlerAndrew Dolgov
* DiskCache: multiple fixes; support isWritable() for cache entries, set content-disposition for send() * public/cached_url: allow selecting files from sub-caches other than images * plugins/Cache_Starred_Images: rework to use DiskCache, can be enabled per-user, properly handles article enclosures, etc
2019-08-13expire_cached_files to DiskCache::expire()Andrew Dolgov
2019-06-20move more globals to more appropriate placesAndrew Dolgov
set libxml to always use internal errors
2019-06-20move several more global functions to more appropriate classesAndrew Dolgov
2019-05-12parser: force libxml error messages to valid utf8Andrew Dolgov
2019-04-10use DEFAULT_SEARCH_LANGUAGE to generate tsvector index if per-feed language ↵Andrew Dolgov
is not specified, also use it as default value on search form for convenience
2019-03-21domdocument: remove old meta charset unicode hacks, replace with shorter xml ↵Andrew Dolgov
preamble utf8 hack (on loadhtml where it makes sense) af_readability: better (?) charset hack for non-unicode pages