glitchier-soc

Commit Graph

Author	SHA1	Message	Date
unarist	4acb1c73dd	Improve error handling on LinkCrawlWorker (#5250 ) * Improve error handling on LinkCrawlWorker * Ignore TimeoutError and InvalidURIError too * Record errors to debug log * Enable dead job queue on LinkCrawlWorker Since most of acceptable errors were already ignored, only our side issue should go to dead job queue. * Ignore all http gem errors	7 years ago
Eugen Rochko	8eca42b265	Separate background jobs into different queues. ATTENTION: new queue "pull" must be added to the Sidekiq invokation in your systemd file The pull queue will handle link crawling, thread resolving, and OStatus processing. Such tasks are more likely to hang for a longer time (due to network requests) so it is more sensible to not make the "in-house" tasks wait for them.	8 years ago
Eugen Rochko	f748a91ec7	Fix #463 - Fetch and display previews of URLs using OpenGraph tags	8 years ago

Author

SHA1

Message

Date

unarist

4acb1c73dd

Improve error handling on LinkCrawlWorker (#5250 )

* Improve error handling on LinkCrawlWorker

* Ignore TimeoutError and InvalidURIError too
* Record errors to debug log
* Enable dead job queue on LinkCrawlWorker

Since most of acceptable errors were already ignored, only our side issue should go to dead job queue.

* Ignore all http gem errors

Eugen Rochko

8eca42b265

Separate background jobs into different queues. ATTENTION: new queue "pull"

must be added to the Sidekiq invokation in your systemd file

The pull queue will handle link crawling, thread resolving, and OStatus
processing. Such tasks are more likely to hang for a longer time (due to
network requests) so it is more sensible to not make the "in-house" tasks
wait for them.

Eugen Rochko

f748a91ec7

Fix #463 - Fetch and display previews of URLs using OpenGraph tags

3 Commits (87f1b249c110bb18447712d914fe757831526471)