AI Tools

Text Dataset Cleaner

Clean and preprocess text data for ML training with configurable operations.

Remove Duplicate Lines

Remove exact duplicate lines

Strip HTML Tags

Remove all HTML/XML tags

Normalize Whitespace

Collapse multiple spaces/tabs to single space, trim lines

Remove URLs

Remove http/https URLs

Remove Email Addresses

Remove email addresses

Lowercase

Convert all text to lowercase

Remove Special Characters

Keep only letters, numbers, spaces, and basic punctuation

Remove Short Lines (<3 words)

Remove lines with fewer than 3 words

Remove Empty Lines

Remove blank lines

Input

0 lines0 chars~0 tokens

Cleaned Output

0 lines0 chars~0 tokens

Verwandte Tools