LangSmith now supports decision models including Jev and SemIf
LangSmith now supports decision models, including Jev and SemIf, and provides visibility into every step.
LangSmith now supports decision models, including Jev and SemIf, and provides visibility into every step.
LangChain says LangSmith Custom Apps can create interfaces from agent data with a prompt, including views for labeling runs, comparing experiments, and reviewing traces.
LangChain announced LangSmith Engine v2 at Interrupt. It identifies agent issues before production, tests proposed fixes before showing them to users, and surfaces inefficient agent work along with cost and latency trends.
LangChain announced LangSmith Engine v2 at Interrupt and says it can proactively find agent issues and resolve them before users see them.
The session covers the key elements of online evals and how teams can use Tuned Evaluators to analyze agent interactions and attach feedback to production traces.
LangChain says Jev-as-a-judge is now available in LangSmith. The company claims it can score every production trace, check more criteria per trace without rising cost, and catch safety or security issues fast enough to trigger an automated response.