README.md

---
title: Code Similarity Visualization with GraphCodeBERT
emoji: 🧠
colorFrom: gray
colorTo: blue
sdk: gradio
sdk_version: 5.38.0
app_file: app.py
pinned: false
license: mit
short_description: Augmenting the Interpretability of GraphCodeBERT
---

# Code Similarity Visualization with GraphCodeBERT

This interactive application visualizes token-level embeddings generated by [GraphCodeBERT](https://huggingface.co/microsoft/graphcodebert-base) for classical sorting algorithms. It supports pairwise comparison of algorithms based on their representation in the model’s embedding space, using PCA for dimensionality reduction.

## ✒️ Reference

Martinez-Gil, J. (2025).  
**Augmenting the Interpretability of GraphCodeBERT for Code Similarity Tasks**.  
*International Journal of Software Engineering and Knowledge Engineering*, 35(05), 657–678.

## 🚀 Features

- Select two classical sorting algorithms.
- Automatic tokenization and embedding via GraphCodeBERT.
- PCA-based projection into 2D space for visualization.
- Clear matplotlib plots showing token-level distribution differences.

## 🧠 Technical Overview

- **Model**: [`microsoft/graphcodebert-base`](https://huggingface.co/microsoft/graphcodebert-base)
- **Embedding Layer**: Last hidden state
- **Reduction**: Principal Component Analysis (PCA)
- **Interface**: Gradio
- **Languages**: Python 3.10+

## 🛠 Dependencies

All required libraries are listed in `requirements.txt`:

```

transformers
torch
scikit-learn
numpy
matplotlib
gradio
Pillow

```

## 🖥️ Intended Use

- Academic teaching and demonstration of code embeddings
- Qualitative evaluation of pretrained models for source code
- Supplementary visualization for software engineering publications

## 📬 Contact

**Jorge Martinez-Gil**  
Senior Research Scientist in Computer Science