Releases: aws-solutions-library-samples/accelerated-intelligent-document-processing-on-aws
v0.4.3
[0.4.3]
Fixed
- Fix #134 - Doc class dropdown shows no options when editing sections
- Fix #133 - Cast topK to int to defend against transient ValidationException exceptions
- Fix #132 - TRACKING_TABLE environment variable needed in EvaluationFunction
- Fix #131 - HITL functions broken post docker migration
- Fix #130 - Enable EU models for Agent Configuration and KB Configuration
- Add ServiceUnavailableException to retryable exceptions in statemachine to better defend against processing failure due to quota overload
- Evaluation Configuration Robustness
- Improved JSON Schema error messages with actionable diagnostics when configuration issues occur
- Added automatic type coercion for numeric constraints (e.g.,
maxItems: "7"→maxItems: 7) to handle common YAML parsing quirks gracefully
- UI: Document Schema Editor Input Field Fixes
- Fixed Examples, Default Value, Const, and Enum Values fields not allowing first character deletion or comma input
- Fixed Enum field remaining disabled after clearing Const value
- Fixed "Clear all enum values" button not working
- Fixed empty Evaluation Method picklist for Array[String] and other simple array types
Templates
- us-west-2:
https://s3.us-west-2.amazonaws.com/aws-ml-blog-us-west-2/artifacts/genai-idp/idp-main_0.4.3.yaml - us-east-1:
https://s3.us-east-1.amazonaws.com/aws-ml-blog-us-east-1/artifacts/genai-idp/idp-main_0.4.3.yaml - eu-central-1:
https://s3.eu-central-1.amazonaws.com/aws-ml-blog-eu-central-1/artifacts/genai-idp/idp-main_0.4.3.yaml
v0.4.2
Added
-
Stickler-Based Evaluation System for Enhanced Comparison Capabilities
- Migrated evaluation service from custom comparison logic to AWS Labs Stickler library for structured object evaluation
- Field Importance Weights: New capability to assign business criticality weights to fields (e.g., shipment ID weight=3.0 vs notes weight=0.5)
- Enhanced Configuration: Added
x-aws-idp-evaluation-*extensions for evaluation configuration - Backward compatible: Maintained API compatibility - all existing code works unchanged
- Enhanced Comparators: Leverages Stickler's optimized comparison algorithms (Exact, Levenshtein, Numeric, Fuzzy, Semantic) with LLM evaluation preserved through custom wrapper
- Better List Matching: Hungarian algorithm via Stickler for optimal list comparisons regardless of order
-
UI: Evaluation Configuration in Document Schema UI
- Added evaluation weight, threshold (with conditional display), and document-level match threshold fields for complete Stickler configuration control
- Added LEVENSHTEIN and HUNGARIAN evaluation methods with auto-populated threshold defaults based on selected method
-
IDP CLI Force Delete All Resources Option
- Added
--force-delete-allflag toidp-cli deletecommand for comprehensive stack cleanup - Post-CloudFormation Cleanup: Analyzes resources after CloudFormation deletion completes to identify retained resources (DELETE_SKIPPED status)
- Use Cases: Complete test environment cleanup, CI/CD pipelines requiring full teardown, cost optimization by removing all retained resources
- Added
Changed
-
Containerized Pattern-1 and Pattern-3 Deployment Pipelines
- Migrated Pattern-1 and Pattern-3 Lambda functions to Docker image deployments (following Pattern-2 approach from v0.3.20)
- Builds and pushes all Lambda images via CodeBuild with automated ECR cleanup
- Increases Lambda package size limit from 250 MB (zip) to 10 GB (Docker image) to accommodate larger dependencies
-
Agent Companion Chat - Chat History Feature
- Added chat history feature from Agent Analysis back into Agent Companion Chat
- Users can now load and view previous chat sessions with full conversation context
- Chat history dropdown displays recent sessions with timestamps and message counts
Fixed
-
Agent Companion Chat - Session Persistence and input control
- Agent Companion Chat in-session memory now persists even when user changes pages
- Prompt input is disabled during active streaming responses to prevent concurrent requests
- Fixed issue where charts in loaded chat history were not displaying
-
GovCloud Template Generation errors
- Fixed CloudFormation deployment error
Fn::GetAtt references undefined resource GraphQLApiwhen deploying GovCloud templates
- Fixed CloudFormation deployment error
-
Example Notebook error fixed
- Example notebooks updated to work with new v0.4.0+ JSON schema
Templates
- us-west-2:
https://s3.us-west-2.amazonaws.com/aws-ml-blog-us-west-2/artifacts/genai-idp/idp-main_0.4.2yaml - us-east-1:
https://s3.us-east-1.amazonaws.com/aws-ml-blog-us-east-1/artifacts/genai-idp/idp-main_0.4.2.yaml - eu-central-1:
https://s3.eu-central-1.amazonaws.com/aws-ml-blog-eu-central-1/artifacts/genai-idp/idp-main_0.4.2.yaml
v0.4.1
[0.4.1]
Changed
- Configuration Library Updates with JSON Schema Support
- Updated configuration library with JSON schema format for lending package, bank statement, and RVL-CDIP package samples
- Enhanced configuration files to align with JSON Schema Draft 2020-12 format introduced in v0.4.0
- Updated notebooks and documentation to reflect JSON schema configuration structure
Fixed
- UI Few Shot Examples Display - Fixed issue where few shot examples were not displaying correctly from configuration in the Web UI
- Re-enabled Regex Functionality - Restored document name and page content regex functionality for Pattern-2 classification that was temporarily missing
- Pattern-2 ECR Enhanced Scanning Support - Added required IAM permissions (inspector2:ListCoverage, inspector2:ListFindings) to Pattern2DockerBuildRole to support AWS accounts with Amazon Inspector Enhanced Scanning enabled. Also added KMS permissions (kms:Decrypt, kms:CreateGrant) for customer-managed encryption keys. This resolves AccessDenied errors and CodeBuild timeouts when deploying Pattern-2 in accounts with enhanced scanning enabled.
- Reporting Database Data Loss After Evaluation Refactoring - Fixes #121
- Fixed bug where metering data and document_section data stopped being written to the reporting database after evaluation was migrated from EventBridge to Step Functions workflow
- IDP CLI Deploy Command Parameter Preservation Bug
- Fixed bug where
idp-cli deploycommand was resetting ALL stack parameters to their default values during updates, even when users only intended to change specific parameters
- Fixed bug where
- Pattern-2 Intermittent HITLStatusUpdateFunction ECR Access Failure
- Fixed intermittent "Lambda does not have permission to access the ECR image" (403) errors during Pattern-2 deployment
- Root Cause: Race condition where Lambda functions were created before ECR images were fully available and scannable
- Solution: Enhanced CodeBuild custom resource to verify ECR image availability before completing, including:
- Verification that all required Lambda images exist in ECR repository
- Check that image scanning is complete (repository has
ScanOnPush: true)
- New Parameter: Added
EnablePattern2ECRImageScanningparameter (current default: false) to allow users to enable/disable ECR vulnerability scanning if experiencing deployment issues- Recommended: Set enabled (true) for production to maintain security posture
- Optional: Disable (false) only as temporary workaround for deployment reliability
v0.4.0
[0.4.0]
⚠️ IMPORTANT NOTICE - SIGNIFICANT CONFIGURATION CHANGESThis release introduces significant changes to the accelerator configuration for defining document classes and attributes. The configuration format has been migrated to JSON Schema standards, which provides enhanced flexibility and validation capabilities.
While automatic migration is provided for backward compatibility, customers MUST fully test this update in a non-production environment before upgrading production systems. We strongly recommend:
- Deploy the update to a test/development environment first
- Verify all document processing workflows function as expected
- Test with representative samples of your production documents
- Review the migration guide at docs/json-schema-migration.md
- Only proceed with production upgrade after thorough validation
Do not upgrade production systems without completing validation testing.
Added
-
Agent Companion Chat Experience
- Added comprehensive interactive AI assistant interface providing real-time conversational support for the IDP Accelerator
- Session-Based Architecture: Transformed from job-based (single request/response) to session-based (multi-turn conversations) with unified agentic chat experience
- Persistent Chat Memory: DynamoDB-backed conversation history with automatic loading of last 20 turns, turn-based message grouping, and intelligent context management with sliding window optimization
- Real-Time Streaming: AppSync GraphQL subscriptions enable incremental response streaming with proper async task cleanup and thinking tag removal for clean display
- Code Intelligence Agent: New specialized agent for code-related assistance with DeepWiki MCP server integration, security guardrails to prevent sensitive data exposure, and user-controlled opt-in toggle (default: enabled)
- Rich Chat Interface: Modern UI with CloudScape Design System featuring real-time message streaming, multi-agent support (Analytics, Code Intelligence, Error Analyzer, General), Markdown rendering with syntax highlighting, structured data visualization (charts via Chart.js, sortable tables), expandable tool usage sections, sample prompts, and auto-scroll behavior
- Privacy & Security: Explicit user consent for Code Intelligence third-party services, session isolation with unique session IDs, error boundary protection, input validation
-
JSON Schema Format for Class Definitions - docs/json-schema-migration.md
- Document class definitions now use industry-standard JSON Schema Draft 2020-12 format for improved flexibility and tooling integration
- Standards-Based Validation: Leverage standard JSON Schema validators and tooling ecosystem for better configuration validation
- Enhanced Extensibility: Custom IDP properties use standard JSON Schema extension pattern (
x-aws-idp-*prefix) for clean separation of concerns - Modern Data Contract: Define document structures using widely-adopted JSON Schema format with robust type system (
string,number,boolean,object,array) - Nested Structure Support: Natural representation of complex documents with nested objects and arrays using JSON Schema's native
propertiesanditemskeywords - Automatic Migration: Existing legacy configurations automatically migrate to JSON Schema format on first load - completely transparent to users
- Backward Compatible: Legacy format remains supported through automatic migration - no manual configuration updates required
- Comprehensive Documentation: New migration guide with format comparison, field mapping table, and best practices
-
IDP CLI Single Document Status Support with Programmatic Output
- Enhanced
statuscommand to support checking individual document status via new--document-idoption as alternative to--batch-id - Added programmatic output capabilities with exit codes (0=success, 1=failure, 2=processing) for scripting and automation
- JSON format output (
--format json) provides structured data for parsing in CI/CD pipelines and scripts - Live monitoring support with
--waitflag works for both batch and single document status checks - Mutual exclusion validation ensures only one of
--batch-idor--document-idis specified
- Enhanced
-
Error Analyzer CloudWatch Tool Enhancements
- Enhanced CloudWatch log filtering with request ID-based filtering for more targeted error analysis
- Improved XRay tool tracing and logging capabilities for better diagnostic accuracy
- Enhanced error context correlation between CloudWatch logs and X-Ray traces
- Consolidated and renamed tools
- Provided tools access to agent
- Updated system prompt
-
Error Analyzer CloudWatch Tool Enhancements
- Enhanced CloudWatch log filtering with request ID-based filtering for more targeted error analysis
- Improved XRay tool tracing and logging capabilities for better diagnostic accuracy
- Enhanced error context correlation between CloudWatch logs and X-Ray traces
- Consolidated and renamed tools
- Provided tools access to agent
- Updated system prompt
Fixed
- UI Robustness for Orphaned List Entries - #102
- Fixed UI error banner "failed to get document details - please try again later" appearing when orphaned list entries exist (list# items without corresponding doc# items in DynamoDB tracking table)
- Root Cause: When a document had a list entry but no corresponding document record, the error would trigger UI banner and prevent display of all documents in the same time shard
- Solution: Enhanced error handling to gracefully handle missing documents - now only shows error banner if ALL documents fail to load, not just one
- Enhanced Debugging: Added detailed console logging with full PK/SK information for both list entries and expected document entries to facilitate cleanup of orphaned records
- User Impact: All valid documents now display correctly even when orphaned list entries exist; debugging information available in browser console for identifying problematic entries
v0.3.21
[0.3.21]
Added
-
Claude Sonnet 4.5 Haiku Model Support
- Added support for Claude Haiku 4.5
- Available for configuration across all document processing steps
-
X-Ray Integration for Error Analyzer Agent
- Integrated AWS X-Ray tracing tools to enhance diagnostic capabilities of the error analyzer agent
- X-Ray context enables better distinction between infrastructure issues and application logic failures
- Added trace ID persistence in DynamoDB alongside document status for complete traceability
- Enhanced CloudWatch error log filtering for more targeted error analysis
- Simplified CloudWatch results structure for improved readability and analysis
- Updated error analyzer recommendations to leverage X-Ray insights for more accurate root cause identification
-
EU Region Support with Automatic Model Mapping
- Added support for deploying the solution in EU regions (eu-central-1, eu-west-1, etc.)
- Automatic model endpoint mapping between US and EU regions for seamless deployment
- Comprehensive model mapping table covering Amazon Nova and Anthropic Claude models
- Intelligent fallback mappings when direct EU equivalents are unavailable
- Quick Launch button for eu-central-1 region in README and deployment documentation
- IDP CLI now supports eu-central-1 deployment with automatic template URL selection
- Complete technical documentation in
docs/eu-region-model-support.mdwith best practices and troubleshooting
Changed
-
Migrated Evaluation from EventBridge Trigger to Step Functions Workflow
- Moved evaluation processing from external EventBridge-triggered Lambda to integrated Step Functions workflow step
- Race Condition Eliminated: Evaluation now runs inside state machine before WorkflowTracker marks documents COMPLETE, preventing premature completion status when evaluation is still running
- Config-Driven Control: Evaluation now controlled by
evaluation.enabledconfiguration setting instead of CloudFormation stack parameter, enabling runtime control without stack redeployment - Enhanced Status Tracking: Added EVALUATING status to document processing pipeline for better visibility of evaluation progress
- UI Improvements: Added support for displaying EVALUATING status in processing flow viewer and "NOT ENABLED" badge when evaluation is disabled in configuration
- Consistent Pattern: Aligns evaluation with summarization and assessment patterns for unified feature control approach
-
Migrated UI Build System from Create React App to Vite
- Upgraded to Vite 7 for faster build times
- Updated to React 18, AWS Amplify v6, react-router-dom v6, and Cloudscape Design System
- Reduced dependencies and node_modules size
- Implemented strategic code splitting for improved performance
- Environment variables now use
VITE_prefix instead ofREACT_APP_for local development
Fixed
v0.3.20
[0.3.20]
Added
-
Agentic extraction preview with Strands agents (experimental) introducing intelligent, self-correcting document extraction with improved schema compliance and accuracy improvements over traditional methods.
- Leverages the Strands Agent framework with iterative validation loops and automatic error correction to deliver schema compliance
- Provides structured output through Pydantic models with built-in validators, automatic retry handling, and superior handling of complex nested structures and date standardization
- Includes sample notebooks and configuration assets demonstrating agentic extraction for Pattern-2 lending documents
- Programmatic access available via
structured_outputfunction inlib/idp_common_pkg/idp_common/extraction/agentic_idp.py - Currently this is an experimental feature. Future extensibility includes UI-based validation customization, code generation, and Model Context Protocol (MCP) integration for external data enrichment during extraction
-
IDP CLI - Command Line Interface for Batch Document Processing
- Added CLI tool (
idp_cli/) for programmatic batch document processing and stack management - Key Features: Deploy/update/delete CloudFormation stacks, process and reprocess documents from local directories or S3 URIs, live progress monitoring with rich terminal UI, download processing results locally, validate manifests before processing, generate manifests from directories with automatic baseline matching
- Selective Reprocessing: New
rerun-inferencecommand to reprocess documents from specific pipeline steps (classification or extraction) while leveraging existing OCR data for cost/time optimization - Evaluation Framework: Workflow for accuracy testing including initial processing, manual validation, baseline creation, and automated evaluation with detailed metrics
- Analytics Integration: Query aggregated results via Athena SQL or use Agent Analytics in Web UI for visual analysis
- Use Cases: Rapid configuration iteration, large-scale batch processing, CI/CD integration, automated accuracy testing, automated environment cleanup, prompt engineering experiments
- Documentation: README with Quick Start, Commands Reference, Evaluation Workflow, and troubleshooting guides
- Added CLI tool (
-
Extraction Results Integration in Summarization Service
- Integrates extraction results from the extraction service into summarization module for context-aware summaries
- Features: Fully backward compatible (works with or without extraction results), automatic section handling, error resilient with graceful continuation, comprehensive logging
- Configuration: Enable by adding
{EXTRACTION_RESULTS}placeholder totask_promptin config.yaml - Benefits: Context-aware summaries referencing extracted values, improved accuracy and quality, better extraction-summary alignment
Changed
- Containerized Pattern-2 deployment pipeline that builds and pushes all Lambda images via CodeBuild using the new Dockerfile, plus automated ECR cleanup and tests.
- Lambda docker image deployments have a 10 GB image size limit compared to the 250 MB zip limit of regular deployment. This however doesn't allow for viewing the code in the AWS console.
The change was introduced to accommodate the increased package size of introducing Strands into the package dependencies.
- Lambda docker image deployments have a 10 GB image size limit compared to the 250 MB zip limit of regular deployment. This however doesn't allow for viewing the code in the AWS console.
Fixed
- Discovery function times out when processing large documents.
- increase lambda discovery processor timeout to 900s
- Corrected baseline directory structure documentation in evaluation.md
- Fixed incorrect baseline structure showing flat
.jsonfiles instead of proper directory hierarchy - Updated to correct structure:
<document-name>/sections/1/result.json - Reorganized document for better logical flow and user experience
- Fixed incorrect baseline structure showing flat
- GovCloud Template Generation - Removed GraphQLApi References - #82
- Fixed invalid GovCloud template generation where ProcessChanges AppSync resources were not being removed, causing "Fn::GetAtt references undefined resource GraphQLApi" errors
- Updated
scripts/generate_govcloud_template.pyto remove all ProcessChanges-related resources and extend AppSync parameter cleanup to all pattern stacks - Fixed InvalidClientTokenId validation error by ensuring CloudFormation client uses the correct region when validating templates (commercial vs GovCloud)
- Enhanced Processing Flow Visualization for Disabled Steps
- Fixed UX issue where disabled processing steps (when
summarization.enabled: falseorassessment.enabled: falsein configuration) appeared visually identical to active steps in the "View Processing Flow" display - Key Benefit: Users can now immediately see which steps are actually processing data vs. steps that execute but skip processing based on configuration settings, preventing confusion about whether summarization or assessment ran
- Limitation: the new visual indicators are driven from the current config, which may have been altered since the document was processed. We will address this in a later release. See Issue #86.
- Fixed UX issue where disabled processing steps (when
Known Issues
- GovCloud Deployments fail, due to lack of ARM support for CodeBuild. Fix targeted for next release.
v0.3.19
[0.3.19]
Added
-
Error Analyzer (Troubleshooting Tool) for AI-Powered Failure Diagnosis
- Introduced intelligent AI-powered troubleshooting agent that automatically diagnoses document processing failures using Claude Sonnet 4 with the Strands agent framework
- Key Capabilities: Natural language query interface, intelligent routing between document-specific and system-wide analysis, multi-source data correlation (CloudWatch Logs, DynamoDB, Step Functions), root cause identification with actionable recommendations, evidence-based analysis with collapsible log details
- Web UI Integration: Accessible via "Troubleshoot" button on failed documents with real-time job status, progress tracking, automatic job resumption, and formatted results (Root Cause, Recommendations, Evidence sections)
- Tool Ecosystem: 8 specialized tools including analyze_errors (main router), analyze_document_failure, analyze_recent_system_errors, CloudWatch log search tools, DynamoDB integration tools, and Lambda context retrieval - additional tools will be added as the feature evolves.
- Configuration: Configurable via Web UI including model selection (Claude Sonnet 4 recommended), system prompt customization, max_log_events (default: 5), and time_range_hours_default (default: 24)
- Documentation: Comprehensive guide in
docs/error-analyzer.mdwith architecture diagrams, usage examples, best practices, troubleshooting guide.
-
Claude Sonnet 4.5 Model Support
- Added support for Claude Sonnet 4.5 and Claude Sonnet 4.5 - Long Context models
- Available for configuration across all document processing steps
Fixed
-
Problem with setting correctly formatted WAF IPv4 CIDR range - #73
-
Duplicate Step Functions Executions on Document Reprocess - GitHub Issue #66
- Eliminated duplicate workflow executions when reprocessing large documents (>40MB, 500+ pages)
- Root Cause: S3
copy_objectoperations were triggering multiple "Object Created" events for large files, causingqueue_senderto create duplicate document entries and workflow executions - Solution: Refactored
reprocess_document_resolverto directly create fresh Document objects and queue to SQS, completely bypassing S3 event notifications - Benefits: Eliminates unnecessary S3 copy operations (cost savings)
v0.3.18
Added
- Lambda Function Execution Cost Metering for Complete Cost Visibility
- Added Lambda execution cost tracking to all core processing functions across all three processing patterns
- Dual Metrics: Tracks both invocation counts ($0.20 per 1M requests) and GB-seconds duration ($16.67 per 1M GB-seconds) aligned with official AWS Lambda pricing
- Context-Specific Tracking: Separate cost attribution for each processing step enabling granular cost analysis per document processing context
- Automatic Integration: Lambda costs automatically integrate with existing cost reporting infrastructure and appear alongside AWS service costs (Textract, Bedrock, SageMaker)
- Configuration Integration: Added Lambda pricing entries to all 7 configuration files in
config_library/using official US East pricing
Fixed
- Defect in v0.3.17 causing workflow tracker failure to (1) update status of failed workflows, and (2) update reporting database for all workflows #72
v0.3.17
Added
-
Edit Sections Feature for Modifying Class/Type and Reprocessing Extraction
- Added Edit Sections interface for Pattern-2 and Pattern-3 workflows with reprocessing optimization
- Key Features: Section management (create, update, delete), classification updates, page reassignment with overlap detection, real-time validation
- Selective Reprocessing: Only modified sections are reprocessed while preserving existing data for unmodified sections
- Processing Pipeline: All functions (OCR/Classification/Extraction/Assessment) automatically skip redundant operations based on data presence
- Pattern Compatibility: Full functionality for Pattern-2/Pattern-3, informative modal for Pattern-1 explaining BDA not yet supported
-
Analytics Agent Schema Optimization for Improved Performance
- Embedded Database Overview: Complete table listing and guidance embedded directly in system prompt (no tool call needed)
- On-Demand Detailed Schemas:
get_table_info(['specific_tables'])loads detailed column information only for tables actually needed by the query - Significant Performance Gains: Eliminates redundant tool calls on every query while maintaining token efficiency
- Enhanced SQL Guidance: Comprehensive Athena/Trino function reference with explicit PostgreSQL operator warnings to prevent common query failures like
~regex operator mistakes - Faster Time-to-Query: Agent has immediate access to table overview and can proceed directly to detailed schema loading for relevant tables
Fixed
- Fix missing data in Glue tables when using a document class that contains a dash (-).
v0.3.16
[0.3.16]
Added
-
S3 Vectors Support for Cost-Optimized Knowledge Base Storage
- Added S3 Vectors as alternative vector store option to OpenSearch Serverless for Bedrock Knowledge Base with lower storage costs
- Custom resource Lambda implementation for S3 vector bucket and index management (using boto3 s3vectors client) with proper IAM permissions and resource cleanup
- Unified Knowledge Base interface supporting both vector store types with automatic resource provisioning based on user selection
-
Page Limit Configuration for Classification Control
- Added
maxPagesForClassificationconfiguration option to control how many pages are used during document classification - Default Behavior:
"ALL"- uses all pages for classification (existing behavior) - Limited Page Classification: Set to numeric value (e.g.,
"1","2","3") to classify only the first N pages - Important: When using numeric limit, the classification result from the first N pages is applied to ALL pages in the document, effectively forcing the entire document to be assigned a single class with one section
- Use Cases: Performance optimization for large documents, cost reduction for documents with consistent classification patterns, simplified processing for homogeneous document types
- Added
-
CloudFormation Service Role for Delegated Deployment Access
- Added example CloudFormation service role template that enables non-administrator users to deploy and maintain IDP stacks without requiring ongoing administrator permissions
- Administrators can provision the service role once with elevated privileges, then delegate deployment capabilities to developer/DevOps teams
- Includes comprehensive documentation and cross-referenced deployment guides explaining the security model and setup process
Fixed
- Fixed issue where CloudFront policy statements were still appearing in generated GovCloud templates despite CloudFront resources being removed
- Fix duplicate Glue tables are created when using a document class that contains a dash (-). Resolved by replacing dash in section types with underscore character when creating the table, to align with the table name generated later by the Glue crawler - resolves #57.
- Fix occasional UI error 'Failed to get document details - please try again later' - resolves #58
- Fixed UI zipfile creation to exclude .aws-sam directories and .env files from deployment package
- Added security recommendation to set LogLevel parameter to WARN or ERROR (not INFO) for production deployments to prevent logging of sensitive information including PII data, document contents, and S3 presigned URLs
- Hardened several aspects of the new Discovery feature