Data Structure ?
23.71G
Data Structure ?
*The above analysis is the result extracted and analyzed by the system, and the specific actual data shall prevail.
README.md
ウィキペディアのダンプファイルには大量のマークアップが含まれています。ウィキメディアテキストはマークダウンとHTMLのハイブリッドであり、使いにくいものになっています。しかし、ウィキペディアは非常に価値のあるデータセットです。私はより使いやすい形式が欲しかったのです。
内容
このデータセットには約40MBのJSONファイルが含まれており、それぞれのファイルにはウィキペディアの記事のコレクションが含まれています。JSON内の各記事要素には、ID番号、記事のタイトル、記事のテキストという3つのキーのみが含まれています。各記事は「平坦化」されて、1つの平文文字列にまとめられています。これにより、マークアップ版とは対照的に、人間が読みやすくなります。また、自然言語処理タスクも行いやすくなります。クリーンアップ作業も大幅に減ります。
各ファイルは次のようになっています:
[
{
"id": "17279752",
"text": "ホーソーンロードはイングランドのブートルにあるクリケットとサッカーのグラウンドでした...",
"title": "ホーソーンロード"
}]謝辞
すべての感謝はウィキペディアに捧げます！ウィキペディアの構築や資金提供に協力してくれたすべての人、そしてウィキペディアの内容に時間と専門知識を寄与してくれたすべての人に感謝します。
×
The dataset is currently being organized and other channels have been prepared for you. Please use them
The dataset is currently being organized and other channels have been prepared for you. Please use them
Note: Some data is currently being processed and cannot be directly downloaded. We kindly ask for your understanding and support.
No content available at the moment
No content available at the moment
- Share your thoughts
Go share your ideas~~
ALL
Welcome to exchange and share
Your sharing can help others better utilize data.
Data usage instructions:
I. Data Source and Display Explanation:
- 1. The data originates from internet data collection or provided by service providers, and this platform offers users the ability to view and browse datasets.
- 2. This platform serves only as a basic information display for datasets, including but not limited to image, text, video, and audio file types.
- 3. Basic dataset information comes from the original data source or the information provided by the data provider. If there are discrepancies in the dataset description, please refer to the original data source or service provider's address.
II. Ownership Explanation:
- 1. All datasets on this site are copyrighted by their original publishers or data providers.
III. Data Reposting Explanation:
- 1. If you need to repost data from this site, please retain the original data source URL and related copyright notices.
IV. Infringement and Handling Explanation:
- 1. If any data on this site involves infringement, please contact us promptly, and we will arrange for the data to be taken offline.
- 1. The data originates from internet data collection or provided by service providers, and this platform offers users the ability to view and browse datasets.
- 2. This platform serves only as a basic information display for datasets, including but not limited to image, text, video, and audio file types.
- 3. Basic dataset information comes from the original data source or the information provided by the data provider. If there are discrepancies in the dataset description, please refer to the original data source or service provider's address.
- 1. All datasets on this site are copyrighted by their original publishers or data providers.
- 1. If you need to repost data from this site, please retain the original data source URL and related copyright notices.
- 1. If any data on this site involves infringement, please contact us promptly, and we will arrange for the data to be taken offline.
VIP Download(0.24/day)
Download
25 
294
0
0
collect
Share