Skip to content

A tool that can be used to view logs compressed in CLP's IR Stream format.

License

Notifications You must be signed in to change notification settings

davemarco/yscope-log-viewer-fork

This branch is 1 commit ahead of, 19 commits behind y-scope/yscope-log-viewer:main.

Folders and files

NameName
Last commit message
Last commit date

Latest commit

30526b2 · Oct 25, 2024

History

66 Commits
Oct 24, 2024
Oct 24, 2024
Oct 24, 2024
Oct 25, 2024
Jan 23, 2024
Oct 24, 2024
Oct 24, 2024
Oct 24, 2024
Feb 27, 2023
Oct 24, 2024
Oct 24, 2024
Oct 24, 2024
Oct 24, 2024
Oct 24, 2024
Oct 24, 2024
Oct 24, 2024

Repository files navigation

YScope Log Viewer

Open bug reports Open feature requests CLP on Zulip

yscope-log-viewer is a tool that can be used to view log files. It currently supports CLP's compressed log files (IR streams) and JSON log files. The viewer can be used to navigate the log file, filter by log level, view the logs with syntax highlighting, and generate direct links to specific log events.

To start a local server for accessing the application locally, refer to our build guide.

See the features in development section for upcoming features.

Online Demo

  • A demo of the log viewer can be found at https://yscope.com/log-viewer
  • The demo loads a Hadoop YARN log file from the hive-24hrs log dataset.
    • More info on the dataset and other datasets can be found here.
  • To open an IR stream, drag and drop it onto the log viewer or use the open file dialog.

Generating IR Stream Logs

IR stream log files can currently be generated using these libraries:

How does it work?

The log viewer is written using the ReactJS framework and uses the open source monaco-editor and clp-ffi-js.

The viewer spawns a worker to assist with computationally intensive tasks such as:

  • Deserializing the file and creating an index of logs events.
  • Paginating the indexed logs.
  • Decoding the deserialized log events into plain text.

Tasks are passed to the worker as needed and changes are rendered in the UI.

Providing Feedback

You can use GitHub issues to report a bug or request a feature.

Join us on Zulip to chat with developers and other community members.

Contributing

See the docs in our developer guide.

Features in Development

  • Pretty printing to enhance the readability of structured data in the logs.
  • A dashboard to visualize the distribution of log types and log levels.
  • Support for plain text, archived log files, and other requested formats.
  • Searching within a file, multiple files, or within provided time ranges.
  • Infinite scrolling instead of pagination.
  • Log correlation with sync by timestamp across multiple editors.
  • Automatic conversion of text log files to IR stream format in the browser.
  • Deployment of components via NPM.

About

A tool that can be used to view logs compressed in CLP's IR Stream format.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • TypeScript 91.2%
  • CSS 4.3%
  • JavaScript 2.9%
  • Python 1.3%
  • HTML 0.3%