Coinbase Unleashes AI-Powered Crypto Protocol: Autonomous Payments Revolution Begins

Coinbase just dropped a bombshell that merges artificial intelligence with cryptocurrency transactions—and traditional finance won't know what hit it.

The Autonomous Transaction Protocol

This isn't just another incremental update. Coinbase's new system cuts out human intermediaries entirely, allowing AI agents to execute crypto payments independently. Think self-driving cars, but for your digital assets—no coffee breaks, no human error, just pure algorithmic efficiency.

Smart contracts now get smarter with machine learning integration, bypassing traditional verification steps that typically slow everything down. Transactions that used to take minutes now happen in seconds—because apparently waiting for blockchain confirmations is so 2023.

Finance traditionalists are probably clutching their pearls right about now. Banks still can't decide whether crypto is a scam or the future, while Coinbase just handed the keys to the machines. Another day, another disruption—Wall Street's playing checkers while crypto plays 4D chess with AI.

Large reasoning models (LRMs) are gaining traction in AI for their ability to generate step-by-step reasoning traces. However, a new benchmark study by Together AI reveals a critical gap in these models' ability to adhere to instructions during their reasoning process. This finding raises concerns over the controllability and reliability of these models in complex tasks.

ReasonIF: A New Benchmark Dataset

The study introduces ReasonIF, a benchmark dataset designed to evaluate the instruction-following capabilities of LRMs. Comprising 300 math and science problems, ReasonIF pairs each problem with specific reasoning instructions. The dataset assesses how well models comply with these directives, which cover aspects such as multilingual reasoning, word limits, and formatting constraints.

The research highlights that while LRMs often comply with instructions in their final outputs, they frequently fail to do so during the reasoning process. This discrepancy becomes more pronounced as task difficulty increases, indicating a significant challenge in the field of AI.

Instruction Adherence Challenges

According to Together AI, the tested models demonstrated poor instruction-following (IF) capabilities in reasoning traces, with the best model achieving less than a 25% adherence score. This stark contrast to main response adherence highlights a fundamental shortfall in current LRM capabilities. Particularly, models struggled with formatting-sensitive tasks, such as adhering to JSON formatting and uppercase-only constraints.

Further analysis showed that the instruction-following score (IFS) dropped significantly with increasing task difficulty. This trend was consistent across different model families, emphasizing the need for improved instruction-following mechanisms in LRMs.

Implications for AI Deployment

The inability of LRMs to consistently follow instructions during reasoning has significant implications for real-world applications. In scenarios where complex tasks and nuanced instructions are common, this shortcoming undermines the trustworthiness and safety of AI systems. Users cannot reliably assume that models will respect their requirements throughout the reasoning process, limiting their integration into critical workflows.

The study also explored potential strategies to enhance reasoning instruction fidelity, such as multi-turn reasoning and Reasoning Instruction Fine-tuning (RIF) using synthetic data. Preliminary results indicate that RIF can improve adherence scores, though there remains substantial room for improvement.

For a more comprehensive understanding of the study, the paper and related resources are available on the Together AI website.

• ai
• machine learning
• benchmark study