Understand Word Embedding in Natual Language Processing using Blocked-based Programming

Learning Objectives

After completing this assignment, learners should be able to:

• Understand the basic concept of word embedding.
• Understand the key idea of using word embedding to analyze human language.

Part 1: Environment Setting

Follow the next steps to complete the assignment:

• Step 1. Start a browser and get into Snap!.
• Step 2. Enable JavaScript extension by selecting the "JavaScript extensions” item in the setting menu (as shown in the screenshot below).



Note that the JavaScript extension for NLP is adopted from the work of Ken Kahn.

• Step 3. Download the assignment file (save it as NLP.xml) and import it into the current environment (as shown in the screenshot below).



If the assignment file (NLP.xml) is imported successfully, the tasks and other information will be shown (as shown in the screenshot below). If not, try to import it again.



• Step 4. You can export the assignment once you have done (as shown in the screenshot below).

Part 2: Assignment

The assignment consists of seven different tasks. Each task is carefully designed to faciliate learning the key idea of word embedding, where the former one inspires the next one. Typically, learners with the basic block-programming knowledge can complete within 1 hour. The task list given in the assignment:

• Task 1. Being familiar with Snap!

• Task 2-1. Generate a vector for "cat" and visualize it

• Task 2-2. Calculate the distance from "dog" to "cat"

• Task 2-3. Find the closest word to "cat"

• Task 2-4. Find the five closest words to "cat"

• Task 2-5. Use the word embedding method to answer which of the following words is closer to “Mouse”

• Task 2-6. Modify the program to calculate the distance between “man” and “king”

• Task 2-7. Use the word embedding method to compare the relationships between word groups.

The list of all the related files for the assignment, including the supporting materials:

• NLP.xml - Assignment File including all the tasks and the external libary.

• Worksheet.pdf - PDF version of the assignment and the requirement on each task.

• Blocks Function Reference Manual.pdf - Function description on the key blocks used in the assignment.

• Snap! Reference Manual.pdf - Official Snap! reference manual.

Part 3: Assessment

Teachers could use the reference answers to assess the submitted assignment from learners.