We've completely rebuilt how Rapidi displays live information from your integrations. Instead of manually refreshing pages or waiting for periodic updates, you now see changes as they happen.
The Rapidi interface now streams updates directly to your browser. When your integration runs, you see the output immediately. When a schedule changes status, you see it right away. No page refresh needed.
This applies to:
- Logs - Watch transfer output as it happens
- Runs - See run status updates in real-time
- Data Errors - Get notified of issues the moment they occur
- Groups - Monitor group execution status as transfers complete
- Schedules - See schedule status changes as the engine updates them (Implemented on the Active Schedules for now)
How It Works
We implemented a background job system that monitors your services. Each service with an open monitoring page gets a dedicated job that checks for changes every two seconds.
For schedules, we built a smart caching layer. The system remembers what's currently shown on your screen and only looks for changes to specific fields: Last date/time, Next date/time, and Status. This keeps the streaming fast without putting extra load on the system.
The technical foundation is Solid Queue, a job processing system built by Shopify and now part of Ruby on Rails. It handles thousands of small jobs efficiently and runs them almost instantly.
A Better User Experience
Real-time streaming changes how you work with Rapidi. You see problems the moment they happen, not minutes later after clicking refresh. Manual transfers show output as they run, so you always know what's going on. Schedule status updates appear as soon as the engine processes them - right on the same page without reloading or switching between tabs.
Updated Interface for Groups and Schedules
Along with the streaming updates, we refreshed the Groups and Schedules user interface.
For Groups, the controls moved to an action bar above the list. Select your group, choose your tags, and click Run Transfer/Group. This makes it clearer which group you're working with before you take action.
Schedules got the same layout refresh with streaming updates baked in.
Technical Details for the Curious
The streaming system runs as background jobs using Solid Queue. We moved away from our previous Delayed Jobs/Cron Jobs system to get better performance for small, fast jobs.
The new setup can split large jobs into smaller pieces and run more work in parallel. Small operations, like fetching status messages, now run as background jobs with streaming, letting them start almost instantly while still being properly managed.
Memory usage dropped significantly with our latest infrastructure changes. The system runs even more efficiently while handling more concurrent users.
What's Next
We're continuing to expand real-time streaming across the platform.
Have questions about the new streaming features? Contact our support and development team.
Join our Open Office Hours every Thursday to learn more about a specific Topic
