For a given document stored in the data warehouse, compress the words by applying following preprocessing technique separately. i. Normalization ii. Normalization and stemming iii. Stop words removal
Added by Jason Z.
Step 1
- Remove any punctuation marks and special characters. - Replace any variations of words with a standard form (e.g., "color" and "colour" to "color"). - Example: "The Quick Brown Fox Jumps Over the Lazy Dog!" becomes "the quick brown fox jumps over the lazy Show more…
Show all steps
Your feedback will help us improve your experience
Vysakh M and 78 other AP CS educators are ready to help you.
Ask a new question
Labs
Want to see this concept in action?
Explore this concept interactively to see how it behaves as you change inputs.
Key Concepts
Recommended Videos
You use the Process Documents from Data operator on an ExampleSet and the result has over 19000 attributes: What parameters could you change to reduce the number of regular attributes while trying to keep the most useful ones? (Select one) A. De-select the "add meta information" parameter. B. Use pruning. C. Select the "memory-optimized" data management parameter. D. Add a Select Attributes operator after Process Documents from Data.
Vysakh M.
Which of the following process is used to reduce the set of representation keywords when you have very large collections? a. Text-operation b. Text-separation c. reduction d. Compression
Aparna S.
How to compress the word "access" using the statistical method?
Supreeta N.
Recommended Textbooks
Computer Science and Information Technology
Introduction to Programming Using Python
Computer Science - An Overview
Transcript
Watch the video solution with this free unlock.
EMAIL
PASSWORD