Inside VAKRA: Reasoning, Tool Use, and Failure Modes of Agents
•
28
AI & ML interests
Enterprise AI and ML, Foundation Models, Responsible AI
Recent Activity
Papers
IndustryAssetEQA: A Neurosymbolic Operational Intelligence System for Embodied Question Answering in Industrial Asset Maintenance
Efficient Agent Evaluation via Diversity-Guided User Simulation
Articles
ibm-research/cif-dataset
Viewer • Updated • 301k
ibm-research/hemolab-bench
Viewer • Updated • 49.7k
ibm-research/MermaidSeqBench
Viewer • Updated • 132 • 32 • 5
ibm-research/WikiVQABench
Viewer • Updated • 344 • 44 • 5
ibm-research/STaD
Preview • Updated • 937 • 1
ibm-research/ITBench-Lite
Updated • 1.35k • 5
ibm-research/ScarfBench
Updated • 929 • 6
ibm-research/AssetOpsBench
Viewer • Updated • 467 • 782 • 24
ibm-research/VAKRA
Viewer • Updated • 1.33k • 1.32k • 43
ibm-research/data-product-benchmark
Viewer • Updated • 33.2k • 466 • 3
ibm-research/900K-Judgements
Viewer • Updated • 939k • 86 • 3
ibm-research/VAREX
Viewer • Updated • 1.78k • 722 • 4
ibm-research/BPO-Bench
Preview • Updated • 75 • 1
ibm-research/watsonxDocsQA
Viewer • Updated • 1.22k • 208 • 5
ibm-research/AITQARetrieval
Viewer • Updated • 3.99k • 69
ibm-research/flow-bench
Viewer • Updated • 546 • 11 • 2
ibm-research/FailureSensorIQ
Viewer • Updated • 8.3k • 199 • 6
ibm-research/WatsonxDocsQARetrieval
Viewer • Updated • 1.2k • 30
ibm-research/StatCanDialogueRetrieval
Viewer • Updated • 7.65k • 53
ibm-research/MultiHierttRetrieval
Viewer • Updated • 11.9k • 45 • 1
ibm-research/OTTQASmallRetrieval
Viewer • Updated • 31.1k • 21 • 1
ibm-research/NQTablesRetrieval
Viewer • Updated • 533k • 35 • 2
ibm-research/OpenWikiTablesRetrieval
Viewer • Updated • 178k • 32 • 1
ibm-research/FeTaQARetrieval
Viewer • Updated • 24.7k • 84
ibm-research/rag-hpo-bench
Preview • Updated • 284 • 2
ibm-research/acp_bench
Viewer • Updated • 3.72k • 1.41k • 13
ibm-research/dp-bench
Updated • 21 • 1
ibm-research/ITBench-Trajectories
Updated • 294 • 3
ibm-research/nc-bench
Viewer • Updated • 720 • 90 • 1
ibm-research/Auto-BenchmarkCard
Viewer • Updated • 105 • 67 • 3