3 posts tagged with "workflow automation"

Ever needed a quick table to track trade ideas, journal entries, watchlist notes, or custom reference data — without setting up a full database? With the new User Lists feature, you can create, edit, query, and delete structured data tables directly inside the platform, all without writing a single line of SQL.

Think of it as Microsoft Lists — but built right into your workflow engine.

What Are User Lists?​

A User List is a simple table stored as one document in MongoDB. Each list has:

• Columns — named fields (no strict type system — store strings, numbers, dates, or anything else in the same column)
• Rows — the data itself, editable inline like a spreadsheet
• User isolation — every list is owned by exactly one user. Nobody else can see, edit, or delete it
• Workflow association — optionally link a list to a specific workflow

Lists live in the Profile → Lists tab, right next to Workflows and other tools.

Query With a Simple DSL​

You don't need SQL to find what you're looking for. The built-in filter DSL uses plain words:

status eq active AND age gt 18
name contains john OR role eq admin
price gte 100 AND price lte 500

Supported operators: eq, neq, gt, gte, lt, lte, contains, startswith, endswith, in, exists. Combine with AND / OR and parentheses ( ).

Use Cases​

Access From Workflows​

The User Lists worker exposes all CRUD operations as workflow nodes. You can:

1. Read a list → process with other workers
2. Add a row from signal output (e.g. log trade signals)
3. Update rows based on market conditions
4. Delete old entries in a cleanup step

All operations go through the same WebSocket channel as the rest of the platform — no REST endpoints, no external dependencies.

Available Functions​

Start Using It​

Open Profile → Lists in the sidebar, click New List, give it a name, define your columns, and start entering data. To use lists in a workflow, add the User Lists worker and select the function you need.

Disclaimer: User Lists are designed for convenience storage — configuration, reference data, notes, and small-to-medium datasets. For high-volume or analytical workloads, use MongoDB directly or export to DuckDB.

Trading signals are only as good as the data they carry. Raw price action signals lack the context needed for confident decision-making. The Signal Enricher worker transforms basic signals into comprehensive trading opportunities by adding 46+ technical indicators calculated at each signal's exact timestamp.

Key Advantages​

1. 46+ Professional Indicators in One Worker No need to juggle multiple tools or write custom code. Access institutional-grade indicators:

• Momentum: RSI, Stochastic, Williams %R, CCI, ROC, MFI, PPO, TSI, UO, STOCHRSI
• Trend: SMA, EMA, MACD, ADX, OBV, Vortex, Trend Strength, ATR Trend
• Volatility: Bollinger Bands, ATR, ATR Channel, Keltner Channels, Donchian Channels
• Volume: OBV, CMF, Force Index, Ease of Movement, Volume Oscillator
• Statistical: Standard Deviation, Z-Score, Hurst Exponent, R-Squared
• Advanced: Williams Alligator, Fractal Adaptive MA, Triple EMA, Adaptive MA

2. Strategy Optimization & Parameter Discovery Explore how different indicators transform your data to find optimal strategy conditions. The Signal Enricher helps you:

• Test multiple indicators on the same dataset
• Discover which indicators work best for specific market conditions
• Identify parameter ranges that maximize profitability
• Compare indicator effectiveness across different timeframes

3. Multi-Asset Portfolio Support Handle signals across multiple symbols simultaneously:

• Automatic symbol-based matching with OHLC data
• Process entire portfolios in single workflow
• No duplicate data processing per symbol

4. Advanced Change Detection Detect indicator crossovers and momentum shifts with bar offset capability:

• Compare current vs previous bar values
• Identify when RSI crosses above 30 or below 70
• Track MACD signal line crossovers
• Monitor trend strength changes

5. Seamless Workflow Integration Connects perfectly with your trading ecosystem:

• Feed enriched signals to Signal Generator for rule-based filtering
• Send to Backtest Strategy for lightning-fast vectorized profitability analysis
• Combine with Ratio Rates Pattern Analysis for advanced parameter optimization
• Display on Multi Chart widgets for visual confirmation
• Store in MongoDB or Redis for persistence
• Send alerts via Telegram Notify

What is Signal Enricher?​

The Signal Enricher calculates technical indicators from OHLC data at each signal's timestamp, adding powerful analytical context to your trading signals. Whether you're enhancing existing signals or exploring how different indicators transform your data to find optimal strategy conditions, this worker provides the flexibility to test and discover profitable approaches.

Core Features​

Supported Indicators​

Momentum Oscillators

• RSI (Relative Strength Index) - Overbought/oversold levels
• Stochastic - Price momentum vs range
• Williams %R - Momentum oscillator
• CCI (Commodity Channel Index) - Deviation from mean
• ROC (Rate of Change) - Percentage price change
• MFI (Money Flow Index) - Volume-weighted momentum
• PPO (Percentage Price Oscillator) - MACD percentage version
• TSI (True Strength Index) - Double-smoothed momentum
• UO (Ultimate Oscillator) - Multi-timeframe momentum
• STOCHRSI - Stochastic applied to RSI

Trend Indicators

• SMA/EMA - Moving averages
• MACD - Convergence/divergence
• ADX - Trend strength
• OBV - Volume-based momentum
• Vortex - Trend direction strength
• Trend Strength - EMA difference percentage
• ATR Trend - Volatility-based trend strength

Volatility & Channels

• Bollinger Bands - Price channels
• ATR - True range volatility
• ATR Channel - Dynamic support/resistance
• Keltner Channels - ATR-based channels
• Donchian Channels - Price extremes

Volume & Flow

• Chaikin Money Flow - Buying/selling pressure
• Force Index - Price-volume force
• Ease of Movement - Price movement efficiency
• Volume Oscillator - Volume momentum

Statistical & Advanced

• Standard Deviation - Price volatility
• Z-Score - Standard deviations from mean
• Hurst Exponent - Long-term memory
• R-Squared - Trend strength coefficient
• Williams Alligator - Three EMA system
• FRAMA - Adaptive moving average
• TEMA - Triple exponential MA
• AMA - Adaptive moving average

How Bar Offset Enables Change Detection​

The bar offset feature allows you to access indicator values from different bars relative to the signal time, enabling sophisticated signal confirmation.

Bar Offset Examples​

{
  "indicator": "rsi",
  "bar_offset": 0,
  "new_column_name": "RSI_current"
}

Gets RSI at signal time.

{
  "indicator": "rsi", 
  "bar_offset": -1,
  "new_column_name": "RSI_previous"
}

Gets RSI from previous bar.

Change Detection Workflow​

1. Enrich with current RSI (bar_offset: 0)
2. Enrich with previous RSI (bar_offset: -1)
3. Use Signal Generator to create condition:
   • RSI_previous < 30 AND RSI_current > 30 (RSI crosses above 30)
   • RSI_previous > 70 AND RSI_current < 70 (RSI crosses below 70)

This creates signals only when indicators actually change state, filtering out noise.

Multi-Asset Portfolio Enrichment​

Process signals across multiple symbols in one operation:

Input Signals (Multi-Asset)​

[
  {"swing_time_str": "2024-01-15 10:30:00", "action": "buy", "symbol": "AAPL"},
  {"swing_time_str": "2024-01-15 10:30:00", "action": "sell", "symbol": "GOOGL"},
  {"swing_time_str": "2024-01-15 10:31:00", "action": "buy", "symbol": "MSFT"}
]

OHLC Data (Multi-Asset)​

[
  {"time": 1705312200, "open": 180.0, "high": 182.0, "low": 179.0, "close": 181.0, "symbol": "AAPL"},
  {"time": 1705312200, "open": 3000.0, "high": 3020.0, "low": 2990.0, "close": 3010.0, "symbol": "GOOGL"}
]

Output: Enriched Signals​

[
  {"swing_time_str": "2024-01-15 10:30:00", "action": "buy", "symbol": "AAPL", "RSI": 65.2, "MACD": 1.23},
  {"swing_time_str": "2024-01-15 10:30:00", "action": "sell", "symbol": "GOOGL", "RSI": 72.8, "MACD": -0.45}
]

Complete Trading Workflow Integration​

RSI Mean Reversion Strategy​

1. Fetch Price → Get OHLC data for your symbols
2. Signal Enricher → Add RSI, Stochastic, and Bollinger Bands
3. Signal Generator → Create buy signals when:
   • RSI crosses above 30 (oversold bounce)
   • Price touches lower Bollinger Band
   • Stochastic is oversold (< 20)
4. Backtest Strategy → Validate performance with stop losses and take profits
5. Telegram Notify → Send alerts when signals trigger

Trend Following Strategy​

1. Fetch Yahoo → Get price data from Yahoo Finance
2. Signal Enricher → Calculate ADX, Trend Strength, and ATR
3. Signal Generator → Generate signals when:
   • ADX > 25 (strong trend)
   • Trend Strength > 2% (significant momentum)
4. Support Resistance → Add key levels for entry/exit
5. Multi Chart → Visualize signals on price chart

Market Regime Detection​

1. Twelve Data → Fetch comprehensive market data
2. Signal Enricher → Calculate Market Regime and Hurst Exponent
3. AI Classifier → Route signals based on market conditions:
   • High volatility → Use wider stops
   • Trending market → Follow trend
   • Mean-reverting → Counter-trend signals
4. MongoDB → Store regime classifications for analysis

Getting Started Examples​

Basic RSI Enrichment​

Add RSI to your existing signals:

{
  "signals": [{"time": "2024-01-15T10:30:00Z", "symbol": "AAPL"}],
  "data": [{"time": 1705312200, "open": 180, "close": 181, "symbol": "AAPL"}],
  "indicator": "rsi",
  "field": "close",
  "new_column_name": "RSI"
}

Multi-Indicator Setup​

Enrich with multiple indicators in sequence:

1. First enricher: RSI
2. Second enricher: MACD
3. Third enricher: Bollinger Bands
4. Signal Generator uses all three for complex conditions

Change Detection Setup​

Detect RSI crossovers:

1. Enrich with bar_offset: 0 → RSI_current
2. Enrich with bar_offset: -1 → RSI_previous
3. Signal Generator: RSI_previous <= 30 AND RSI_current > 30

Strategy Optimization & Analysis​

Perfect Partner with Ratio Rates Pattern Analysis​

The Signal Enricher works exceptionally well with Ratio Rates Pattern Analysis for advanced strategy optimization:

1. Signal Enricher → Add multiple indicators (RSI, MACD, ATR, etc.) to your signals
2. Ratio Rates → Calculate profitability ratios and pattern correlations across different indicator combinations
3. Discover Optimal Parameters → Identify which indicator thresholds and combinations produce the highest win rates

This combination helps you:

• Find Profitable Indicator Combinations - Test RSI + MACD vs RSI + Stochastic
• Optimize Entry/Exit Parameters - Determine best RSI levels, stop distances, etc.
• Market Condition Filtering - Use ATR or ADX to filter signals by volatility/trend strength
• Pattern Recognition - Identify recurring profitable setups across multiple indicators

Lightning-Fast Backtesting Integration​

Pair Signal Enricher with Backtest Strategy for rapid strategy validation:

1. Signal Enricher → Enrich signals with chosen indicators
2. Backtest Strategy → Vectorized calculation of profitability metrics
3. Instant Results → Get Sharpe ratio, max drawdown, win rate in milliseconds

Why This Combination Excels:

• Vectorized Performance - Test thousands of parameter combinations instantly
• Realistic Execution - Model slippage, commissions, and market impact
• Risk Management - Test various stop loss and take profit levels
• Statistical Confidence - Validate results across different market conditions

Example: RSI Strategy Optimization​

// Workflow: Signal Enricher → Ratio Rates → Backtest Strategy

{
  "step1": {
    "worker": "signal_enricher",
    "params": {
      "indicator": "rsi",
      "bar_offset": 0,
      "new_column_name": "RSI_current"
    }
  },
  "step2": {
    "worker": "ratio_rates",
    "params": {
      "calculate_profitability": true,
      "correlate_indicators": ["RSI_current", "volume", "price_change"]
    }
  },
  "step3": {
    "worker": "backtest_strategy", 
    "params": {
      "entry_condition": "RSI_current < 30",
      "exit_condition": "RSI_current > 70",
      "stop_loss": "2%",
      "take_profit": "5%"
    }
  }
}

This workflow automatically finds the most profitable RSI levels and validates them with professional backtesting.

Data is the lifeblood of modern analysis and decision-making. Raw data streams from APIs, databases, and feeds often need refinement before they become actionable insights. Introducing the Sort & Filter worker - your essential tool for transforming unstructured data into organized, analysis-ready information.

What is Sort & Filter?​

The Sort & Filter worker is a powerful data transformation tool that lets you refine, organize, and structure your data with precision. Whether you're working with financial market data, news feeds, API responses, or any structured data, this worker gives you complete control over how your information is processed and presented.

From filtering out irrelevant records to sorting by importance and selecting only the fields you need, Sort & Filter acts as the bridge between raw data collection and meaningful analysis.

Key Features​

• Advanced Filtering: Apply multiple conditions with AND/OR logic to find exactly the data you need
• Intelligent Sorting: Organize data by any field in ascending or descending order
• Column Selection: Keep only relevant fields and remove unnecessary data
• Result Limiting: Control output size for better performance and focus
• Smart Search: Find text matches using fuzzy similarity for flexible content discovery
• Expression Support: Use dynamic expressions to create custom filtering logic
• Real-time Processing: Handle large datasets efficiently without performance degradation

How It Works​

Visual Data Processing​

Input Connection: Connect to any data source - RSS feeds, API responses, database queries, or other workflow outputs Visual Configuration: Set up your filters, sorting, and column selection through an intuitive interface Live Preview: See your data transformation results instantly as you configure Output Integration: Pass refined data to charts, alerts, storage, or further processing

Flexible Filtering System​

The worker supports multiple filter types that can be combined with AND/OR logic:

• Numeric Filters: Compare prices, volumes, scores, and metrics
• Text Filters: Search for keywords, categories, or content
• Date Filters: Filter by time ranges and chronological order
• Similarity Search: Find related content using intelligent text matching
• Custom Expressions: Create complex logic using data field references

Practical Applications​

Financial News Analysis​

Transform raw news feeds into focused market intelligence:

Use Case: Monitor specific company news from multiple sources

• Filter Bloomberg, Reuters, and Yahoo Finance feeds for "Apple" OR "AAPL"
• Sort by publication date (newest first)
• Select only title, summary, and URL fields
• Limit to top 10 most recent articles

Result: A clean, focused news stream perfect for dashboard display or automated alerts.

Market Data Refinement​

Clean and organize trading data for analysis:

Use Case: Prepare stock data for technical analysis

• Filter for stocks with volume > 1M AND price > $50
• Sort by market cap descending
• Select price, volume, and sector fields
• Remove unnecessary metadata

Result: Analysis-ready data that loads faster and displays cleaner in charts.

Content Moderation​

Filter user-generated content or social media data:

Use Case: Monitor brand mentions across platforms

• Filter posts containing your brand name with similarity search
• Exclude spam using negative filters
• Sort by engagement metrics
• Limit to most relevant results

Result: High-quality content streams for sentiment analysis and brand monitoring.

API Response Optimization​

Streamline data from external APIs:

Use Case: Process e-commerce product data

• Filter products in stock with rating > 4.0
• Sort by price ascending
• Select name, price, and image fields
• Limit to top 50 results

Result: Optimized data payloads that improve app performance and user experience.

Workflow Integration​

Connect with Data Sources​

RSS Feeds: Process news articles from Fetch RSS worker Market Data: Refine data from Twelve Data or FRED connectors API Responses: Clean data from HTTP Request worker Database Queries: Filter results from MongoDB or Redis workers Social Media: Process Reddit or Twitter data streams

Feed Analysis Tools​

Charts & Visualizations: Send filtered data to chart widgets AI Analysis: Pass refined data to AI summarizers or classifiers Alerts & Notifications: Trigger notifications based on filtered conditions Storage: Save processed data to databases or cloud storage Reports: Generate automated reports from organized data

Getting Started Examples​

Basic News Filtering​

1. Add Sort & Filter to your workflow canvas
2. Connect to a Fetch RSS worker output
3. Configure Data Source: Select the RSS results field
4. Add Filter: Title contains "earnings" OR body contains "quarterly results"
5. Set Sorting: Date descending (newest first)
6. Select Columns: Title, URL, publication date
7. Set Limit: 20 articles maximum

Advanced Market Screening​

1. Connect to market data source (Twelve Data, Yahoo Finance, etc.)
2. Create Complex Filter:
   • Price > 100 AND Volume > 500000 AND Sector equals "Technology"
   • OR Price > 500 AND Market Cap > 10B
3. Sort by "Price Change %" descending
4. Select relevant fields for your analysis
5. Connect output to chart widget for visualization

Content Similarity Search​

1. Link to social media or news data
2. Use Similarity Filter: Find articles similar to "artificial intelligence trends"
3. Combine with date filters for recent content
4. Sort by relevance score
5. Feed results to AI summarizer for content condensation

Performance Benefits​

• Faster Loading: Reduce data size with column selection and limits
• Better UX: Show only relevant information to users
• Improved Analysis: Focus on quality data instead of noise
• Cost Efficiency: Process less data, use fewer API calls
• Scalable Workflows: Handle large datasets without performance issues

Why Sort & Filter Matters​

In today's data-driven world, information overload is the biggest challenge. The Sort & Filter worker solves this by giving you surgical precision over your data. Instead of drowning in irrelevant information, you get exactly what you need, when you need it.

Whether you're building financial dashboards, monitoring news feeds, analyzing social media trends, or processing API responses, Sort & Filter ensures your workflows deliver actionable insights, not data dumps.

Transform your raw data into strategic advantages with the Sort & Filter worker - where smart data processing meets intelligent automation.