Data Structure ?
0M
Data Structure ?
*The above analysis is the result extracted and analyzed by the system, and the specific actual data shall prevail.
README.md
文脈
アラビア語は豊かで主要な世界言語です。近年の計算言語学と人工知能の進歩はアラビア語に適用できますが、ほとんどの言語が扱われる一般的な方法では適用できません。このデータセット（ウィキペディアのアラビア語記事）は、Word2Vecを訓練するために使用され、一般的な方法でFastText（Facebook）から公開されている事前学習済みモデルとの性能を比較します。関連するモデルが現在利用可能です：https://www.kaggle.com/abedkhooli/arabic-ulmfit-model
内容
2018年1月20日のデータダンプ（圧縮済み）のすべてのウィキペディアのアラビア語記事がウィキメディア形式です。内容は（ほとんど）現代標準アラビア語であることが期待されます。
謝辞
公開データダンプを提供してくれたウィキペディアと、事前学習済みモデルを公開してくれたFacebookに感謝します。
着想
ここでの課題（機会）は主に、トークンの前処理とテキスト正規化、そして異なる目的のためのハイパーパラメータチューニングにあります。アラビア語のトークンを分離するのは簡単です（多くの記事には非アラビア語の単語が含まれています）が、トークン化は課題です：アクセント付き（7arakaatまたはtashkeel）とアクセントなしの単語形、異なる意味を持つ同じ単語形、接尾辞と接頭辞（特にw）をどのように扱うかです。
×
The dataset is currently being organized and other channels have been prepared for you. Please use them
The dataset is currently being organized and other channels have been prepared for you. Please use them
Note: Some data is currently being processed and cannot be directly downloaded. We kindly ask for your understanding and support.
No content available at the moment
No content available at the moment
- Share your thoughts
Go share your ideas~~
ALL
Welcome to exchange and share
Your sharing can help others better utilize data.
Data usage instructions:
I. Data Source and Display Explanation:
- 1. The data originates from internet data collection or provided by service providers, and this platform offers users the ability to view and browse datasets.
- 2. This platform serves only as a basic information display for datasets, including but not limited to image, text, video, and audio file types.
- 3. Basic dataset information comes from the original data source or the information provided by the data provider. If there are discrepancies in the dataset description, please refer to the original data source or service provider's address.
II. Ownership Explanation:
- 1. All datasets on this site are copyrighted by their original publishers or data providers.
III. Data Reposting Explanation:
- 1. If you need to repost data from this site, please retain the original data source URL and related copyright notices.
IV. Infringement and Handling Explanation:
- 1. If any data on this site involves infringement, please contact us promptly, and we will arrange for the data to be taken offline.
- 1. The data originates from internet data collection or provided by service providers, and this platform offers users the ability to view and browse datasets.
- 2. This platform serves only as a basic information display for datasets, including but not limited to image, text, video, and audio file types.
- 3. Basic dataset information comes from the original data source or the information provided by the data provider. If there are discrepancies in the dataset description, please refer to the original data source or service provider's address.
- 1. All datasets on this site are copyrighted by their original publishers or data providers.
- 1. If you need to repost data from this site, please retain the original data source URL and related copyright notices.
- 1. If any data on this site involves infringement, please contact us promptly, and we will arrange for the data to be taken offline.
VIP Download(0.24/day)
Download
0 
245
0
0
collect
Share