Cosine similarity measures the similarity between two non-zero vectors by calculating the cosine of the angle between them. It is widely used in machine learning and data analysis, especially in text analysis, document comparison, search queries, and recommendation systems.
- Similarity measure calculates the distance between data objects based on their feature dimensions in a dataset.
- A smaller distance indicates a higher similarity, while a larger distance indicates a lower similarity.
Cosine similarity is a metric, helpful in determining, how similar the data objects are irrespective of their size. We can measure the similarity between two sentences in Python using Cosine Similarity. In cosine similarity, data objects in a dataset are treated as a vector.
The formula to find the cosine similarity between two vectors is -
S_C(x, y) = x . y / ||x|| \times ||y||
where,
- x . y = product (dot) of the vectors 'x' and 'y'.
- ||x|| and ||y|| = length (magnitude) of the two vectors 'x' and 'y'.
- ||x|| \times ||y|| = regular product of the two vectors 'x' and 'y'.
Example
Consider an example to find the similarity between two vectors - 'x' and 'y', using Cosine Similarity. The 'x' vector has values, x = { 3, 2, 0, 5 } The 'y' vector has values, y = { 1, 0, 0, 0 } The formula for calculating the cosine similarity is : S_C(x, y) = x . y / ||x|| \times ||y||
x . y = 3*1 + 2*0 + 0*0 + 5*0 = 3
||x|| = √ (3)^2 + (2)^2 + (0)^2 + (5)^2 = 6.16
||y|| = √ (1)^2 + (0)^2 + (0)^2 + (0)^2 = 1
∴ S_C(x, y) = 3 / (6.16 * 1) = 0.49
The dissimilarity between the two vectors 'x' and 'y' is given by -
∴ D_C(x, y) = 1 - S_C(x, y) = 1 - 0.49 = 0.51
- The cosine similarity between two vectors is measured in 'θ'.
- If θ = 0°, the 'x' and 'y' vectors overlap, thus proving they are similar.
- If θ = 90°, the 'x' and 'y' vectors are dissimilar.
Cosine Similarity between two vectorsSome of the popular similarity measures are given below:
- Euclidean Distance
- Manhattan Distance
- Jaccard Similarity
- Minkowski Distance
- Cosine Similarity
Advantages
- The cosine similarity is beneficial because even if the two similar data objects are far apart by the Euclidean distance because of the size, they could still have a smaller angle between them. Smaller the angle, higher the similarity.
- When plotted on a multi-dimensional space, the cosine similarity captures the orientation (the angle) of the data objects and not the magnitude.
Disadvantages
- Sensitive to Sparse Data: Ineffective for sparse data with many zero components; other similarity measures may work better.
- Ignores Magnitude: Considers only the angle between vectors, missing differences in magnitude.
- Symmetric: Cannot distinguish the order of comparison, which may be undesirable in some tasks.
Similar Reads
Similarity Search for Time-Series Data Time-series analysis is a statistical approach for analyzing data that has been structured through time. It entails analyzing past data to detect patterns, trends, and anomalies, then applying this knowledge to forecast future trends. Time-series analysis has several uses, including in finance, econ
15+ min read
Web Information Retrieval | Vector Space Model It goes without saying that in general a search engine responds to a given query with a ranked list of relevant documents.The purpose of this article is to describe a first approach to finding relevant documents with respect to a given query. In the Vector Space Model (VSM), each document or query i
5 min read
Python | Measure similarity between two sentences using cosine similarity Cosine similarity is a measure of similarity between two non-zero vectors of an inner product space that measures the cosine of the angle between them. Similarity = (A.B) / (||A||.||B||) where A and B are vectors. Cosine similarity and nltk toolkit module are used in this program. To execute this pr
2 min read
Compute a Cosine Dissimilarity Matrix in R Cosine dissimilarity is a measure used in various fields such as text mining, clustering, and data analysis to quantify the difference between two non-zero vectors. It is derived from the cosine similarity, which calculates the cosine of the angle between two vectors in a multi-dimensional space. Wh
3 min read
How to Calculate Cosine Similarity in R? In this article, we are going to see how to calculate Cosine Similarity in the R Programming language. We can define cosine similarity as the measure of the similarity between two vectors of an inner product space. The formula to calculate the cosine similarity between two vectors is: ΣXiYi / (√ΣXi^
2 min read