Charts for realtime metrics are enabled out of the box without any external dependencies. Charts are helpful for monitoring health and troubleshooting from within Oban Web because not all apps can, or will, run an extra timeseries or metrics database. And, because they’re displayed alongside the original jobs, you can identify outliers in aggregate and then drill into individual jobs.
- Select between execution counts, full counts, execution time, and wait time
- Aggregate time series by state, node, worker, or queue label
- Rollup metrics by time from 1s to 2m, spanning 90s to 3h of historic data
- Measure execution and wait times across percentiles, from 100th down to 50th at standard intervals
Filtering is entirely overhauled with a new auto-complete interface, new qualifier syntax, and
vastly more performant queries. Full text searching with unindexable operators such as
tsvector was removed in favor of highly optimized exact-match queries. With the new query
syntax all searching is faster, and searching nested
args is over 100x faster thanks to index
One additional performance improvement for large
oban_jobs tables is threshold querying. In
order to minimize load on the application’s database, only the most recent 100k jobs
(approximately) are filtered. The 100k limit can be disabled or configured for each state, i.e. you
could restrict filtering
completed jobs but access the full history of
- Filter by args, meta, node, priority, queue, tags, and worker
- Typeahead with keyboard shortcuts for focusing, selecting, and completing suggestions
- Highly optimized suggestion queries across a configurable number of recent jobs
- Locally cached for immediate feedback and minimal load on your application database
Auto-completion of nested
metakeys and values at any depth
The foundation of charts, filtering, optimized counts, and realtime monitoring is the new
Oban.Met package. It introduces a distributed time-series data store and replaces both
Oban.Web.Plugins.Stats with zero-config implementations that are much
- Telemetry powered execution tracking for time-series data that is replicated between nodes, filterable by label, arbitrarily mergeable over windows of time, and compacted for longer playback.
- Centralized counting across queues and states with exponential backoff to minimize load and data replication between nodes.
- Ephemeral data storage via data replication with handoff between nodes. All nodes have a shared view of the cluster’s data and new nodes are caught up when they come online.
In the future
Oban.Met modules will be public, documented, and available for use from your own
Oban.Web.Plugins.Statsplugin is no longer necessary and you should remove it from your plugins:
plugins: [ - Oban.Web.Plugins.Stats, ...
Oban.Plugins.Gossipplugin is no longer necessary and you should remove it from your plugins:
plugins: [ - Oban.Plugins.Gossip, ...
Require a minimum of Elixir v1.13 for compatibility with features required by
Require a minimum of Phoenix v1.7 to support verified routes.
Require a minimum of Phoenix LiveView v0.19 for various features and bug fixes.
[PubSub] Indicate when PubSub isn’t connected or receiving notifications with a warning and explanation
[Refresh] Persist refresh selection between sessions and resume the most recent value after pausing on window blur
[Themes] Support selecting light, dark, or system theme via a dropdown menu
[Shortcuts] Introduce keyboard shortcuts modal that’s accessible by pressing
[Shortcuts] Add shortcuts to toggle refreshing, cycle themes, focus search, and navigate between pages
Display canvas based charts for exec count, full count, exec time, and queue time
Restore chart options on page reload, including whether it’s collapsed
Indicate which filters are applied when charts are filtered
Limit plotting large series, e.g.
workersto the 7 highest activity series. Without limitation charts are slow and unreadable.
Estimate counts and times to a fixed size with a unit suffix
Restrict filtering and searching to a configurable maximum number of jobs. The default is 100k, which can be disabled or customized with a resolver callback.
Calculate all relative timestamps on the client to minimize updates over the wire
Reimplement jobs list view with simpler components without per-column sorting for better performance.
Use a dropdown menu for job sorting to more clearly indicate which field is used for sorting and the sort direction.
Orphans, jobs stuck in an executing state, are now marked with an status indicator
Elevate “States” to the top of the sidebar and visually clarify that they’re for navigation while “Nodes” and “Queues” are filters.
Always display a standard toggle icon rather than showing one on hover
Use counts reported by
oban_met. Counts are only reported by a single node and larger queue/state combinations are counted with exponential backoff.
Removed from the queues page to maximize table space
Reduce param tracking and Use
navigateon links for filter changes without a full update
jobs_query_limit/1callback to control the maximum number of jobs to query when filtering, searching, or generally listing jobs
hint_query_limit/1callback to control the number of recent jobs to search for auto-complete hints.
[Queues] Correctly handle toggling global limits on and off
[Queues] Track global limit changes on edit without requiring increment or decrement
[Web] Prevent lingering tooltips by by destroying instances on unmount