File size: 1,227 Bytes
2328918
 
8bf5029
 
 
2328918
 
 
 
 
8bf5029
2328918
8bf5029
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
---
title: Nn Ext
emoji: πŸ¦€
colorFrom: blue
colorTo: purple
sdk: streamlit
sdk_version: 1.31.0
app_file: app.py
pinned: false
---
# Streamlit app with neural network πŸ’‘

## TeamπŸ§‘πŸ»β€πŸ’»
1. [Diachenko Ilia](https://github.com/DiaElijah)
2. [Yerlan Baidildin](https://github.com/YerlanBaidildin)

## Task πŸ“Œ
1. Parse a movie database online.
2. Creating a service for semantic movie search using pre-trained language models.

## Contents πŸ€–
1. Data parsing was carried out from the site πŸ“½οΈ [kino.mail.ru](https://kino.mail.ru/cinema/all/)
2. Models used for semantic search πŸ€– [rubert-tiny2](https://huggingface.co/cointegrated/rubert-tiny2) and 😎 [msmarco-MiniLM-L-12-v3](https://www.sbert.net/docs/pretrained-models/msmarco-v3.html)
3. The library was used for semantic search πŸ‘Ύ [Sentence Transformers](https://www.sbert.net/examples/applications/semantic-search/README.html#)

## Libraries πŸ“–
```python
import json
import requests
from bs4 import BeautifulSoup
import pandas as pd
import time
import csv
import re
import ast
import re
import string
import nltk
import pymorphy2
import streamlit as st
import numpy as np
import torch
from sentence_transformers import SentenceTransformer, util
```