參考
BGI-online網(wǎng)站
使用BGI Online CLI下載華大基因釋放的數(shù)據(jù)
目前BGI數(shù)據(jù)主要提供三種下載方式
提供網(wǎng)頁(yè)下載
(單或多個(gè)文件)袜瞬、客戶端下載
(Windows)公罕,以及CLI批量下載
(Linux)等多種方式。
1.網(wǎng)頁(yè)版下載
step1: 登錄BGI-online網(wǎng)站
step2:選擇項(xiàng)目當(dāng)個(gè)文件進(jìn)行下載:
tips: 當(dāng)選中文件夾韧拒,不提供下載功能
2.客戶端下載
推薦使用Windows64位系統(tǒng)下載數(shù)據(jù)
Step1、下載GUI軟件壓縮包并解壓十性,鏈接:https://pan.genomics.cn/ucdisk/s/AZjime
備注:Windows32位系統(tǒng):參考上述鏈接下的幫助文檔
OS X和Linux系統(tǒng):將當(dāng)前路徑移到解壓文件夾叛溢,在命令行執(zhí)行“sh bgionline.sh”登錄界面
Step2:解壓后雙擊GUI-win\GUI-win-3.0目錄下Windows批處理文件bgionline_gui.bat,也就是如下紅框內(nèi)的軟件
Step3:在如下登錄頁(yè)面劲适,先點(diǎn)擊紅框內(nèi)的設(shè)置符號(hào)
Step4:在訪問(wèn)節(jié)點(diǎn)選擇框中刪除后面的:1001楷掉,刪除:1001后點(diǎn)擊確認(rèn)
Step5:在登錄頁(yè)面輸入用戶名、密碼霞势,登錄后即可下載所有數(shù)據(jù)烹植,請(qǐng)務(wù)必在14天內(nèi)下載所有數(shù)據(jù)
Step6:下載全部數(shù)據(jù)
3.CLI命令行批量下載
- 系統(tǒng)要求
Linux, OS X, Unix, or Windows
Python 2.7
pip
Step1:創(chuàng)建python2.7 conda 環(huán)境,安裝bgionline
# 基于 python2.7 創(chuàng)建一個(gè)名為test_py2 的環(huán)境
conda create --name BGI_Download python=2.7
conda activate BGI_Download
安裝軟件
$ pip install bgionline
更新軟件
$ pip install --upgrade bgionline
Step2: 查看工具幫助文件
$ bo -h
usage: bo [-h] [--version] command ...
BGI Online Command line client, version 2.2.6
optional arguments:
-h, --help show this help message and exit
--version show program's version number and exit
--config CONFIG Configuration Files folder
available commands:
{login,logout,new,select,pwd,whoami,sh,tree,ls,cd,mkdir,rm,mv,upload,download,find,transfer}
login Log in (interactively or with an existing API token)
logout Log out and remove credentials
new Create a new user/project/analysis from scratch
select List and select a project to switch to
pwd Print current working directory
sh bo shell interpreter
tree List folders and objects in a tree
ls List folders and/or objects in a folder
cd Change the current working directory
mkdir Create a new folder
rm Remove data objects and folders
mv Move or rename objects and/or folders inside a project
upload Upload file(s) or directory
download Download file(s) or directory
find Find data/job/app/project
transfer transfer project to user
Step3: 登錄賬號(hào)
(BGI_Download) [13:27:27] kcao@h1-lgl:~$ bo login
Logging into https://app.bgionline.cn:1001
Username: 20190227F18FTSCCWLI4389
Password: WHFUNrdmE_20190227
輸入郵件中的用戶名和密碼,即可生成相應(yīng)的配置文件夾~/.bgionline/愕贡。
ou are now logged in. Your configurations are stored in /share/disk02_8T/home/chenlianfu/.bgionline/setting.
Use bo select to choose your working project...
Available projects:
+-------+--------------------------------------+-------------------------+
| index | project id | project name |
+-------+--------------------------------------+-------------------------+
| 0 | 3d7d64df-b0a6-439a-a443-fb73058f9925 | 20190227F18FTSCCWLJ4389 |
+-------+--------------------------------------+-------------------------+
Pick a numbered choice :0
選擇一個(gè)目標(biāo)項(xiàng)目草雕。
Setting current project to: 20190227F18FTSCCWLJ4389
(BGI_Download) [13:27:27] kcao@h1-lgl:~$ bo ls
F18FTSCCWLJ4389_FUNrdmD/
可以列出選定項(xiàng)目中的文件信息
(BGI_Download) [13:27:27] kcao@h1-lgl:~$ bo tree
/
└──F18FTSCCWLJ4389_FUNrdmD
└──Upload_Delivery_F18FTSCCWLJ4389_FUNrdmD_PureSequence
├──BGI_result
│ └──Separate
4 directories
以樹(shù)形式列出選定項(xiàng)目中所有的文件夾層次信息
(BGI_Download) [13:27:27] kcao@h1-lgl:~$ bo dowload / ./
將項(xiàng)目中的所有文件夾下載到當(dāng)前工作目錄下。