TruLens v1.0.3

Bug Fixes

• Relax minor package version constraints by @coreyhu in #1482
• Claude 3 support for AWS Bedrock by @coreyhu in #1481
• Fix content loss in multithreading by @glennfeys in #1478
• Change default init_serverside to False by @coreyhu in #1483
• Add min_score, max_score, temperature, and custom criteria to feedback api by @coreyhu in #1489

TruLens v1.0.2

Bug Fixes

• Support for Langchain feedback provider BaseLLM by @sfc-gh-dkurokawa in #1459
• Enable recording of apps that use Snowflake Cortex models by @sfc-gh-chu in #1461
• Allow logging for non-sqlite databases that have existing (non-TruLens) tables by @DavidKurokawa in #1449
• Fix optional packaging dependencies by @sfc-gh-pmardziel in #1471
• Moved requests/Endpoint post to Huggingface provider by @sfc-gh-chu in #1476
• Docs fixes by @sfc-gh-chu in #1473

TruLens v1.0.1

Moving to TruLens v1: Reliable and Modular Logging and Evaluation

TruLens v1 is here! Read the announcement blog and check out our migration guide for moving from trulens_eval.

TruLens 1.0 Announcement Blog

TruLens-Eval v0.33.1

Bug Fixes

• Fix for punkt breaking change to groundedness feedback function
• Fix incompatibility with latest pip version

TruLens-Eval v0.32.1

Bug Fixes

• Fix for punkt breaking change to groundedness feedback function
• Fix incompatibility with latest pip version

TruLens-Eval v0.31.1

Bug Fixes

• Fix for punkt breaking change to groundedness feedback function
• Fix incompatibility with latest pip version

TruLens-Eval v0.33.0

What's Changed

• timeouts for wait_for_feedback_results by @sfc-gh-pmardziel in #1267
• TruLens Streamlit components by @sfc-gh-jreini in #1224
• Run the dashboard on an unused port by default by @sfc-gh-jreini in #1280 and @sfc-gh-jreini in #1275

Documentation Updates

• Reflect Snowflake SQLAlchemy Release in "Connect to Snowflake" Docs by @sfc-gh-jreini in #1281
• Update guardrails examples by @sfc-gh-jreini in #1275

Bug Fixes

• Remove duplicated tests by @sfc-gh-dkurokawa in #1283
• fix LlamaIndex streaming response import by @sfc-gh-chu in #1276

Full Changelog: trulens-eval-0.32.0...trulens-eval-0.33.0

TruLens-Eval v0.32.0

What's Changed

• Context filtering guardrails by @sfc-gh-jreini in #1192
• Query optimizations for TruLens dashboard resulting in 4-32x benchmarked speedups by @sfc-gh-chu in #1216
• Logging in Snowflake database by @sfc-gh-chu in #1216
• Snowflake Cortex feedback provider by @sfc-gh-dhuang in #1202
• improve langchain prompting using native messages by @nicoloboschi in #1194
• fix groundedness with no supporting evidence by @nicoloboschi in #1193
• Improve Microsecond support by @sfc-gh-gtokernliang in #1195
• SkipEval exception by @sfc-gh-pmardziel in #1200
• Update pull_request_template.md by @sfc-gh-jreini in #1234
• Use rounding instead of flooring in feedback score extraction by @sfc-gh-dhuang in #1244

Documentation

• Benchmarking Snowflake arctic-instruct feedback function of groundedness by @sfc-gh-dhuang in #1185
• Evaluation Benchmarks Page by @sfc-gh-jreini in #1190
• Documentation for snowflake sqlalchemy implementation by @sfc-gh-chu in #1216*
• Documentation for logging in snowflake database by @sfc-gh-chu in #1216
• Documentation for cortex provider by @sfc-gh-dhuang in #1202

Examples

• Context filtering guardrails added to quickstarts by @sfc-gh-jreini in #1192
• Update Arctic model notebook to use new Cortex provider by @sfc-gh-dhuang in #1202
• New example showing cortex finetuning by @sfc-gh-dhuang in #1202
• show how to add cost/latency/usage details in virtual records by @sfc-gh-jreini in #1197

Bug Fixes

• Enable formatting during PR build. Also format code that wasn't formatted. by @sfc-gh-dkurokawa in #1212
• Fix test cases generation - normalization step for SummEval score by @sfc-gh-dhuang in #1217
• Enable regex to extract floats in score generation by @sfc-gh-dhuang in #1223
• Fix cost tracking in OpenAI and LiteLLM endpoints by @sfc-gh-dhuang in #1228
• remove deprecated legacy caching by @sfc-gh-jreini in #1233
• Remove remaining streamlit legacy caching by @JushBJJ in #1246

trulens-eval-0.31.0

What's Changed

• Parallelize groundedness LLM calls for speedup by @sfc-gh-dhuang in #1180
• Option for quieter deferred evaluation by @epinzur in #1178
• Support for langchain >=0.2.x retrievers via instrumenting the invoke method by @nicoloboschi in #1187

Examples

• ❄️ Snowflake Arctic quickstart by @joshreini1 in #1156

Bug fixes

• Fix a few more old groundedness references + llamaindex agent toolspec import by @daniel-huang-1230 in #1161
• Very minor fix of print statement by @sfc-gh-dhuang in #1173
• Fix sidebar logo formatting by @sfc-gh-chu in https://github.com/truera/trulens/pull/1169\
• [bugfix] prevent stack overflow in jsonify by @piotrm0 in #1176

Full Changelog: trulens-eval-0.30.1...trulens-eval-0.31.0

trulens-eval-0.30.1

What's Changed

• update comprehensiveness by @daniel-huang-1230 and @joshreini1 in #1064
• glossary additions by @piotrm0 in #1144

Bug Fixes

• Add langchain-community to optional requirements by @joshreini1 in #1146
• Checks for use of openai endpoint by @piotrm0 in #1154

Full Changelog: trulens-eval-0.29.0...trulens-eval-0.30.1