2 posts tagged with "financial data"

Data is the lifeblood of modern analysis and decision-making. Raw data streams from APIs, databases, and feeds often need refinement before they become actionable insights. Introducing the Sort & Filter worker - your essential tool for transforming unstructured data into organized, analysis-ready information.

What is Sort & Filter?​

The Sort & Filter worker is a powerful data transformation tool that lets you refine, organize, and structure your data with precision. Whether you're working with financial market data, news feeds, API responses, or any structured data, this worker gives you complete control over how your information is processed and presented.

From filtering out irrelevant records to sorting by importance and selecting only the fields you need, Sort & Filter acts as the bridge between raw data collection and meaningful analysis.

Key Features​

• Advanced Filtering: Apply multiple conditions with AND/OR logic to find exactly the data you need
• Intelligent Sorting: Organize data by any field in ascending or descending order
• Column Selection: Keep only relevant fields and remove unnecessary data
• Result Limiting: Control output size for better performance and focus
• Smart Search: Find text matches using fuzzy similarity for flexible content discovery
• Expression Support: Use dynamic expressions to create custom filtering logic
• Real-time Processing: Handle large datasets efficiently without performance degradation

How It Works​

Visual Data Processing​

Input Connection: Connect to any data source - RSS feeds, API responses, database queries, or other workflow outputs Visual Configuration: Set up your filters, sorting, and column selection through an intuitive interface Live Preview: See your data transformation results instantly as you configure Output Integration: Pass refined data to charts, alerts, storage, or further processing

Flexible Filtering System​

The worker supports multiple filter types that can be combined with AND/OR logic:

• Numeric Filters: Compare prices, volumes, scores, and metrics
• Text Filters: Search for keywords, categories, or content
• Date Filters: Filter by time ranges and chronological order
• Similarity Search: Find related content using intelligent text matching
• Custom Expressions: Create complex logic using data field references

Practical Applications​

Financial News Analysis​

Transform raw news feeds into focused market intelligence:

Use Case: Monitor specific company news from multiple sources

• Filter Bloomberg, Reuters, and Yahoo Finance feeds for "Apple" OR "AAPL"
• Sort by publication date (newest first)
• Select only title, summary, and URL fields
• Limit to top 10 most recent articles

Result: A clean, focused news stream perfect for dashboard display or automated alerts.

Market Data Refinement​

Clean and organize trading data for analysis:

Use Case: Prepare stock data for technical analysis

• Filter for stocks with volume > 1M AND price > $50
• Sort by market cap descending
• Select price, volume, and sector fields
• Remove unnecessary metadata

Result: Analysis-ready data that loads faster and displays cleaner in charts.

Content Moderation​

Filter user-generated content or social media data:

Use Case: Monitor brand mentions across platforms

• Filter posts containing your brand name with similarity search
• Exclude spam using negative filters
• Sort by engagement metrics
• Limit to most relevant results

Result: High-quality content streams for sentiment analysis and brand monitoring.

API Response Optimization​

Streamline data from external APIs:

Use Case: Process e-commerce product data

• Filter products in stock with rating > 4.0
• Sort by price ascending
• Select name, price, and image fields
• Limit to top 50 results

Result: Optimized data payloads that improve app performance and user experience.

Workflow Integration​

Connect with Data Sources​

RSS Feeds: Process news articles from Fetch RSS worker Market Data: Refine data from Twelve Data or FRED connectors API Responses: Clean data from HTTP Request worker Database Queries: Filter results from MongoDB or Redis workers Social Media: Process Reddit or Twitter data streams

Feed Analysis Tools​

Charts & Visualizations: Send filtered data to chart widgets AI Analysis: Pass refined data to AI summarizers or classifiers Alerts & Notifications: Trigger notifications based on filtered conditions Storage: Save processed data to databases or cloud storage Reports: Generate automated reports from organized data

Getting Started Examples​

Basic News Filtering​

1. Add Sort & Filter to your workflow canvas
2. Connect to a Fetch RSS worker output
3. Configure Data Source: Select the RSS results field
4. Add Filter: Title contains "earnings" OR body contains "quarterly results"
5. Set Sorting: Date descending (newest first)
6. Select Columns: Title, URL, publication date
7. Set Limit: 20 articles maximum

Advanced Market Screening​

1. Connect to market data source (Twelve Data, Yahoo Finance, etc.)
2. Create Complex Filter:
   • Price > 100 AND Volume > 500000 AND Sector equals "Technology"
   • OR Price > 500 AND Market Cap > 10B
3. Sort by "Price Change %" descending
4. Select relevant fields for your analysis
5. Connect output to chart widget for visualization

Content Similarity Search​

1. Link to social media or news data
2. Use Similarity Filter: Find articles similar to "artificial intelligence trends"
3. Combine with date filters for recent content
4. Sort by relevance score
5. Feed results to AI summarizer for content condensation

Performance Benefits​

• Faster Loading: Reduce data size with column selection and limits
• Better UX: Show only relevant information to users
• Improved Analysis: Focus on quality data instead of noise
• Cost Efficiency: Process less data, use fewer API calls
• Scalable Workflows: Handle large datasets without performance issues

Why Sort & Filter Matters​

In today's data-driven world, information overload is the biggest challenge. The Sort & Filter worker solves this by giving you surgical precision over your data. Instead of drowning in irrelevant information, you get exactly what you need, when you need it.

Whether you're building financial dashboards, monitoring news feeds, analyzing social media trends, or processing API responses, Sort & Filter ensures your workflows deliver actionable insights, not data dumps.

Transform your raw data into strategic advantages with the Sort & Filter worker - where smart data processing meets intelligent automation.

In today's fast-paced financial markets, access to reliable and comprehensive market data is essential for informed trading and investment decisions. Introducing the Twelve Data Market Data Connector - a powerful worker that provides seamless access to one of the most comprehensive financial data APIs available.

What is Twelve Data Market Data Connector?​

The Twelve Data Market Data Connector integrates with the Twelve Data API to provide access to real-time and historical financial data across multiple asset classes including stocks, forex, cryptocurrencies, ETFs, and mutual funds. Whether you're building trading strategies, conducting fundamental analysis, or developing financial applications, this connector offers everything you need in one unified interface.

With support for over 40 different operations ranging from historical price data to technical indicators and fundamental company information, the Twelve Data connector eliminates the need for multiple data sources and complex API integrations.

Key Features​

• 40+ Operations: From basic price data to advanced technical indicators and fundamental analysis
• Multi-Asset Support: Stocks, forex, crypto, ETFs, mutual funds, and more
• Real-time & Historical Data: Access both live market data and extensive historical datasets
• Global Coverage: Data from exchanges worldwide with automatic timezone handling
• Flexible Parameters: Customizable intervals, date ranges, and output sizes
• Rate Limiting: Built-in per-user rate limiting when using shared API keys
• Error Handling: Robust error handling with clear error messages
• API Key Management: Support for personal API keys or shared environment keys

Core Operations Overview​

1. Market Data Operations - The Foundation​

time_series: Historical and intraday OHLCV data for any symbol quote: Real-time quote snapshots with full market information price: Simple real-time price data for quick checks

2. Technical Analysis Operations​

indicator: 20+ technical indicators including SMA, EMA, RSI, MACD, Bollinger Bands

3. Discovery Operations​

symbol_search: Find symbols by name, exchange, or country exchanges: List all available exchanges and markets

4. Fundamental Operations​

profile: Company overview and basic information fundamentals: Detailed financial statements and metrics dividends, splits, earnings: Historical corporate actions logo: Company logo URLs for branding

5. Financial Statements​

income_statement: Revenue, expenses, and profitability data balance_sheet: Assets, liabilities, and equity information cash_flow: Operating, investing, and financing cash flows

6. ETFs & Mutual Funds​

etfs_list, etfs_world: ETF discovery and global listings mutual_funds_list, mutual_funds_world: Mutual fund data and analysis

7. Calendar & Events​

dividends_calendar, earnings_calendar: Upcoming corporate events ipo_calendar: New public offerings and listings

8. Analyst & Market Data​

earnings_estimate, revenue_estimate: Analyst forecasts recommendations, price_target: Analyst opinions and targets analyst_ratings: Comprehensive analyst coverage

Getting Started - Interface Configuration​

Basic Setup​

1. Select Worker Type: Choose "twelve_data" from the worker selection dropdown
2. Choose Operation: Select your desired operation from the operation dropdown
3. API Key (Optional): Enter your personal Twelve Data API key, or leave blank to use the shared key
4. Configure Parameters: Fill in operation-specific parameters based on your needs

Common Parameters​

• api_key: Your Twelve Data API key (optional if shared key is configured)
• operation: The specific operation you want to perform
• symbol: Stock ticker, forex pair, or crypto symbol (required for most operations)

Operation-Specific Parameters​

Time Series Configuration:

• interval: Data interval (1min, 5min, 15min, 30min, 45min, 1h, 2h, 4h, 1day, 1week, 1month)
• outputsize: Number of data points to return (max 5000)
• start_date/end_date: Date range for historical data
• timezone: Target timezone for timestamps

Technical Indicators:

• indicator: Indicator type (sma, ema, rsi, macd, bbands, etc.)
• time_period: Lookback period for calculation
• series_type: Price series to use (open, high, low, close)

Search & Discovery:

• symbol: Search query for symbol lookup
• exchange: Filter by specific exchange
• country: Filter by country

Advanced Configuration Options​

Rate Limiting Awareness​

When using the shared API key, the system enforces per-user rate limits (5 calls per minute). Make sure your userId is properly configured in the context for accurate limiting.

Data Formatting​

All timestamp data is automatically formatted in ISO format for consistency. You can customize this behavior through additional parameters if needed.

Multi-Symbol Support​

Operations like time_series support comma-separated symbol lists for batch requests, allowing you to fetch data for multiple assets in a single call.

Practical Implementation Examples​

Intraday Trading Strategy​

Create a complete intraday analysis workflow:

1. Fetch Real-time Quotes using the quote operation
2. Calculate Technical Indicators using the indicator operation
3. Monitor Multiple Symbols with batch time_series requests
4. Set Alerts based on price levels and indicator signals

Complete Workflow Example:

• workers[0]: Twelve Data Connector
  • type: twelve_data
  • operation: time_series
  • symbol: AAPL,MSFT,GOOGL
  • interval: 5min
  • outputsize: 100
• workers[1]: Technical Analysis
  • type: technical_analysis
  • indicators: rsi,macd
  • data_source: workers[0].result

Fundamental Analysis System​

Build comprehensive company analysis:

• workers[0]: Company Profile
  • type: twelve_data
  • operation: profile
  • symbol: TSLA
• workers[1]: Financial Statements
  • type: twelve_data
  • operation: income_statement
  • symbol: TSLA
  • period: annual
• workers[2]: Analyst Estimates
  • type: twelve_data
  • operation: earnings_estimate
  • symbol: TSLA

ETF Portfolio Analysis​

Analyze ETF performance and holdings:

• workers[0]: ETF Discovery
  • type: twelve_data
  • operation: etfs_world
  • country: US
• workers[1]: ETF Performance
  • type: twelve_data
  • operation: etfs_world_performance
  • currency: USD

Operations Comparison Table​

Operation Category	Best For	Key Parameters	Output Format
Market Data	Price analysis, charting	symbol, interval, dates	OHLCV arrays
Technical Indicators	Signal generation	indicator, symbol, period	Indicator values
Fundamentals	Company analysis	symbol	JSON objects
Financials	Ratio analysis	symbol, period	Financial statements
ETFs/Mutual Funds	Portfolio construction	filters, limits	Asset listings
Calendars	Event timing	date ranges	Event arrays
Analyst Data	Investment decisions	symbol	Estimates and ratings

Best Practices and Tips​

API Key Management​

• Use personal API keys for higher rate limits and dedicated quotas
• The shared key enforces per-user limits (5/min) to ensure fair usage
• Monitor your API usage through the Twelve Data dashboard

Data Optimization​

• Use appropriate intervals for your analysis timeframe
• Limit outputsize to reduce response times and API costs
• Cache frequently accessed data to minimize API calls

Error Handling​

• Check for API key validity before complex workflows
• Handle rate limit errors gracefully with retry logic
• Validate symbol existence before requesting detailed data

Performance Considerations​

• Batch requests for multiple symbols when possible
• Use historical data endpoints for backtesting
• Implement caching layers for real-time applications

Integration with Other Workers​

Trading Strategy Integration​

Combine with technical analysis workers:

• Support & Resistance Calculator: Use price data for level identification
• Pattern Recognition: Feed historical data for pattern detection
• Risk Management: Incorporate volatility data from indicators

Portfolio Management​

Build comprehensive portfolios:

• Asset Allocation: Use ETF and mutual fund data
• Performance Tracking: Monitor returns with price data
• Rebalancing: Trigger based on fundamental changes

Alert Systems​

Create intelligent notifications:

• Price Alerts: Monitor specific levels with real-time data
• Technical Signals: Generate alerts from indicator crossovers
• Event Notifications: Track earnings and dividend calendars

Conclusion​

The Twelve Data Market Data Connector represents a comprehensive solution for financial data access, providing everything from basic price information to advanced fundamental analysis in a single, easy-to-use interface. Whether you're a retail trader, institutional investor, or financial application developer, this connector offers the flexibility and reliability you need to build sophisticated financial workflows.

With support for global markets, multiple asset classes, and extensive historical data, the Twelve Data connector eliminates data silos and simplifies the development of financial applications. Start exploring the power of comprehensive market data today and unlock new possibilities for your trading and investment strategies.

For detailed guides on specific operations, check out our dedicated articles covering each major operation category with step-by-step interface instructions and practical examples.