Skip to content

CSV validator, highlighter and formatter plugin for JetBrains Intellij IDEA, PyCharm, WebStorm, ...

License

Notifications You must be signed in to change notification settings

SeeSharpSoft/intellij-csv-validator

Repository files navigation

Plugin version Build Action Status EAP Status Coverage Status Known Vulnerabilities Codacy Badge

CSV Editor Plugin for JetBrains IDE family

Compatible with IntelliJ IDEA PhpStorm WebStorm PyCharm RubyMine AppCode CLion Gogland DataGrip Rider MPS Android Studio - 2022.2 and newer

This plugin introduces CSV (Comma-Separated Values) as a language to Jetbrains IDE with a syntax definition, structured language elements and associated file types (.csv/.tsv/.psv). This enables default editor features like syntax validation, highlighting and inspections for CSV-alike files.

CSV Editor Example

Features

  • CSV/TSV/PSV file detection
  • customizable text editor
  • customizable column coloring (rainbow coloring)
  • flexible table editor
  • syntax validation
  • syntax highlighting (customizable)
  • content formatting (customizable)
  • quick fix inspections
  • intentions (Alt+Enter), e.g. Quote/Unquote (all), Shift Column Left/Right
  • support for ',', ';', ':', '|' and '↹' as pre-defined value separator
  • support for freely defined value separators
  • support for line comments (# per default, customizable)
  • tab (↹) separator highlighting

(see full changelog)

NOTE

Release 4.* is focusing on text-editor features. Text-editor is the default editor (again). IntelliJ platform version 2024.2 or newer required.

Previous versions (incl README) can still be accessed and installed manually (see section Installation).

Syntax parser & validation

The CSV syntax parser follows the standard defined in IETF 4180 but tolerates leading and trailing whitespaces of escaped text and accepts basically every literal as text data. This results in a less restrictive checks and contributes to the flexibility of this format. The goal of the plugin is to support editing files in CSV format, not introducing new hurdles.

Being strict, the following CSV snippet is actually incorrect cause of the leading whitespaces. However, it is accepted by the plugins syntax parser implementation:

"firstName", "lastName", "birthday"

Besides the mentioned diversion from the standard definition, syntax errors will be detected and can be inspected. Please note that if a document is syntactically incorrect, other features like the table editor, code formatting or the structure view can not function properly.

Editor with syntax validation and highlighting

Separator

CSV files provide a high degree of flexibility and can be used universally for all kind of data. This led to a variety of CSV derivatives like semicolon or pipe separated values, which share the common format but make use of a different separator.

The plugin supports file-specific separator settings. It comes with a set of predefined separators (Comma (,), semicolon (;), colon (:), tab (↹), pipe (|) and record ('↹'), but can also handle freely chosen separators.

TSV/PSV

A different separator can be chosen for each CSV file.

Additionally, the file types TSV (Tab-Separated-Values) and PSV (Pipe-Separated-Values) were introduced as a kind of CSV language. For TSV and PSV files, the same formatter and code style settings are applied as for CSV itself, but the separator is considered to be a tab or a pipe respectively. All functionality that is available for plain CSV files (table editor, inspections, intentions, etc.) can be used for TSV and PSV as well.

Table Editor

The plugin provides editing of CSV files via a table editor since version 2.0.0. This editor is NOT related to the Edit as table... functionality of IntelliJ IDEA Ultimate/PhpStorm/DataGrip/etc. and does not share any implementation or settings. It is an alternative to the CSV text editor and not meant to replace or mirror the capabilities of the Jetbrains "Data" tab.

!!! IMPORTANT !!!

The table editor requires a syntactically correct formatted CSV file. If the file can't be parsed, the table editor will be not available. The file needs to be fixed first via a text editor before it can be viewed and edited in the table editor.

Table editor

Context menu

A right-click within the table provides a context menu to add/remove rows, right-click on the table header to add/remove columns.

Please note that the actions within the context menu are meant for the current selection of row(s) and column(s), not necessarily for the cell or header where the context menu appears! A right-click does not trigger a selection change by default.

Key bindings

To support working with the table editor fluently, a set of key bindings are available for manipulating and navigating the table view:

  • ARROW KEYS navigate through the table

  • ENTER start/stop editing current cell (NOTE: almost every default key triggers an edit)

  • CTRL+ENTER actual Enter key while editing a cell

  • SHIFT+ENTER stop editing and move to previous row

  • CTRL+SHIFT+ENTER stop editing and move to next row

  • CTRL+SHIFT+LEFT adds a new column before the current cell

  • CTRL+SHIFT+RIGHT adds a new column after the current cell

  • CTRL+SHIFT+DELETE/BACKSPACE deletes the current selected column(s)

  • CTRL+UP adds a new row before the current cell

  • CTRL+DOWN adds a new row after the current cell

  • CTRL+DELETE/BACKSPACE deletes the current selected row(s)

  • DELETE/BACKSPACE clear content of selected cell(s)

Editor Settings

  • File > Settings > Editor > General > CSV/TSV Editor

The plugin introduces an enhanced text editor supporting custom settings - and a table editor. The settings for those can be adjusted in the corresponding CSV/TSV editor settings menu.

Editor settings

General

Editor Usage

The preferred editor usage can be switched between "Text Editor first", "Table Editor first" or "Text Editor only", which has an effect on the editor tab order (or whether the table editor is shown at all). A "Table Editor only" option is not available due to the table editor restrictions when handling erroneous CSV files.

Default Value Separator (CSV only)

The following separators are currently supported: , (Comma), ; (Semicolon), : (Colon), | (Pipe) and (Tab)

since 2.15.0: The default value separator can also be a user defined character sequence.

Default Value Separator defines which separator is used as standard for each newly created or opened CSV file. The separator character can be changed for each file individually in its editors context menu.

Auto Detect

The value separator of a newly opened CSV file can be detected automatically based on the number of predefined separator occurrences.

If Auto Detect is enabled (default), the Default Value Separator setting is only taken into account for newly created files.

Note: This option has no effect on TSV/PSV files, the separator is pre-defined by their file- and language-type.

Default Escape Character

The following escape characters are currently supported: " (Double Quote), \ (Backslash)

Within quoted values (fields starting and ending with a double quote), the double quote character must be escaped to be parsed as part of its value and not to be treated as the closing quote.

Default Escape Character defines which escape character is used as standard for each newly opened CSV/TSV/PSV file. The escape character can be changed for each file individually in its editors context menu.

Line Comment Indicator

Define the character(s) that should be used to mark a line as a comment within a CSV document.

Column numbering

Enable zero-based column numbering. This affects the tooltip info of the text editor as well as column numbering of the table editor.

Value coloring

Choose the coloring method of values. Possible options are:

  • Rainbow (Column Color) - values are colored based on their column.
  • Simple (Text Color) - values are colored based on the defined text color.

All colors can be adjusted via CSV Color Scheme settings.

Text Editor

Highlighting
Highlight caret row

The highlighting of the current caret row might interfere with custom background color settings and can be enabled/disabled for CSV/TSV/PSV files here.

Highlight tab separator

Enable/disable highlighting (and choose the highlight color) of tab characters (↹) in their role as value separator (TSV). Tabs as part of a value are therefore not highlighted on purpose.

Others
Show info balloon

Enable/disable the info balloon that appears at the caret position in the text editor.

Use soft wraps

Set whether soft wrapping should be activated for CSV/TSV/PSV. It still can be changed file specific with right-click on the editors left outer margin.

Keep trailing whitespaces

If enabled, it overrides the default editor settings for trailing whitespace handling to always keep them when editing CSV/TSV/PSV.

Note: This setting has no effect on the table editor. Unquoted values will always be trimmed when opening the table editor. When edited in the table editor, values ending or starting with whitespace will be quoted.

Table Editor

Default row height

The default and initial width of each row in the table in px.

Default column width

The default and initial width of a single table column in px.

Maximum column width

The maximum width of a single table column in px, which is used when adjusting the column widths automatically. 0 deactivates the limitation. This value has no effect when sizing the columns manually in the table editor.

Keep/ignore linebreak at file end

If the file ends with a completely empty line (no spaces or tabs either), the table editor will not show this line as empty values but ignore it. When table data is serialized, an existing empty line is kept at the end of the file.

Enforce value quoting

Always quotes a single value on save - even if not required.

Color Scheme

The different symbols of a CSV document, namely the separator (e.g. comma, pipe, semicolon), the quote character, the escaped literals and the text elements itself, are colored based on the CSV color scheme settings:

  • File > Settings > Editor > Color Scheme > CSV/TSV/PSV

Preset colors are based on Jetbrains IDE defaults and support the different UI themes.

Color scheme settings

Column Colors

Besides the colors and font-style variants for the different CSV symbols, the 10 different column rainbow colors can be defined. Column colors are taken into account when Rainbow is selected as Value Coloring option in the Editor Settings.

Formatting

  • File > Settings > Editor > Code Style > CSV

Format settings

Spaces

Formatting CSV is tricky: On one hand it is easy cause the language has only four different symbols and is generally easy to handle. On the other hand, formatting elements like whitespaces and tabs do have a meaning in CSV. However, in reality when parsing CSV, the leading and trailing whitespaces are quite often ignored or trimmed. Formatting can be completely disabled if no option is selected at all at the settings screen.

The formatting is applied to CSV documents as normal code formatting:

  • Code > Reformat code (Ctrl+Alt+L)

The formatting examples are based on the following CSV snippet as input:

"name", "city", "position"
Annasusanna,Amsterdam,1
  Ben  ,  Berlin  , 2
Separator

Adjust spacing around the separator.

Space before separator

"name" , "city" , "position"
Annasusanna ,Amsterdam ,1
  Ben ,  Berlin , 2

Space after separator

"name", "city", "position"
Annasusanna, Amsterdam, 1
  Ben  , Berlin  , 2
Tabularize

Separator settings can be used in combination with Tabularize, while trimming options are ignored completely. All options in this section only show effect if Format as table is enabled.

Format as table

Adds/removes leading and trailing whitespaces to format the text as a human-readable table.

Note: Formatting a CSV file alters its values, and can conflict with the use of visual table editor.

"name     ","city   ","position"
Annasusanna,Amsterdam,1
Ben        ,Berlin   ,2

Keep quoted value as is

Note: With this option, values in quotes are kept intact. Additionally activating Enforce value quoting for the table editor enables seamless editing and formatting CSV in either text or table mode.

"name"     ,"city"   ,"position"
Annasusanna,Amsterdam,1
Ben        ,Berlin   ,2

Align right

"     name","   city","position"
Annasusanna,Amsterdam,         1
        Ben,   Berlin,         2

Enhanced width calculation

Calculates the width of a text based on each characters width, and taking wide characters into account. This can have a noticeable performance impact on large files.

"name     ","city   ","position"
Annasusanna,Amsterdam,1
汉字宋      ,Berlin   ,2
Trimming

Trimming can be combined with Space before/after separator.

Trim leading whitespaces

"name","city","position"
Annasusanna,Amsterdam,1
Ben  ,Berlin  ,2

Trim trailing whitespaces

"name", "city", "position"
Annasusanna,Amsterdam,1
  Ben,  Berlin, 2

Actions

File specific value separator & escape character

Context menu

The action to switch the value separator (or escape character) - which is used for CSV syntax validation of a specific file - is part of its editors context menu. Since version 2.11.0, also custom separator setting is available via this action.

Please note: This action defines how the parser/validator/highlighter/etc. behaves. It does intentionally NOT change the file content. To be more precise: It does not replace previous separator/escape characters by new ones or adjust the escaped texts.

Auto-fit columns width (table editor only)

Calculates and sets the maximum width for all table columns based on their content. The maximum table column width can be changed via Editor Settings.

Reset column widths to default (table editor only)

Set the width of all table columns back to default. The default table column width can be changed via Editor Settings.

Inspections

  • File > Settings > Editor > Inspections > CSV

Inspections are an IDE feature that can be used to fix syntax errors. They are accessed via Alt+Enter when the cursor is at an erroneous position. The plugin provides three types of inspections:

  • Surround with quotes Surrounds the current field with quotes and escapes already existing ones
  • Add separator Adds a (missing) separator at the cursor position
  • Add closing quote Adds a (missing) closing quote at the end of the document

Intentions

  • File > Settings > Editor > Intentions > CSV

Intentions are similar to inspections and provide a quick way to automatically adjust the document. They are accessed via Alt+Enter at any time. The shown intentions can vary depending on the cursor position within the document. The plugin provides six types of intentions:

  • Quote All Surrounds all unquoted fields with quotes
  • Quote Value Quotes the currently unquoted value at the cursor position
  • Unquote All Unquotes all quoted fields if possible
  • Unquote Value Unquotes the currently quoted value at the cursor position if possible
  • Shift Column Left Shifts the column at cursor position to the left
  • Shift Column Right Shifts the column at cursor position to the right

Installation

Install it from the Jetbrains plugin repository within your IDE (recommended):

  • File > Settings > Plugins > Browse repositories... > Search 'CSV' > Category 'Editor'

You can also download the JAR package from the Jetbrains plugin repository or from GitHub Releases and add it manually to your plugins:

  • File > Settings > Plugins > Install plugin from disk...

Troubleshooting

CSV Editor doesn't seem to work

Please ensure in the settings that the corresponding files types (csv, tab/tsv, psv) are properly mapped (File > Settings > Editor > File Types).

CSV Editor causes the IDE to stop working properly

Since version 2.14.0, the plugins requires the IntelliJ platform to be executed on JRE11 or higher. If this is not the case, the following error log can be noticed:

com.intellij.diagnostic.PluginException: While loading class <className>: <className> has been compiled by a more recent version of the Java Runtime (class file version 55.0), this version of the Java Runtime only recognizes class file versions up to 52.0 [Plugin: net.seesharpsoft.intellij.plugins.csv]

In some cases the error log doesn't seem to point this out in a noticeable manner, but the IDE doesn't work correctly after enabling the plugin. Always disable the plugin first before continuing with the following steps.

Please read the official instructions on how to switch to a newer JRE, or manually install a prior CSV plugin version.

Features of the CSV Editor are not available

If another plugin for CSV files like Rainbow CSV is enabled, this plugin might not be taken into account for parsing and presenting CSV file content.

Therefore, please ensure in the settings the proper mapping of corresponding files types (File > Settings > Editor > File Types).

Contribution

Contributions are welcome. Please check CONTRIBUTING.md for more information.

Besides source code contributions, feel free to open bug reports or just suggest new features here.

Code/feature contributors

  • zoom table-editor cells with Ctrl+Mouse Wheel @royqh1979

Jetbrains Repository

JetBrains Plugin Repository Link: https://plugins.jetbrains.com/plugin/10037-csv-plugin