-
2018-05-24 10:55:24
-
2018-05-22 11:47:16
- 如何优化 Python 爬虫的速度?
- 目前在写一个 Python 爬虫,单线程 urllib 感觉过于慢了,达不到数据量的要求(十万级页面)。求问有哪些可以提高爬取效率的方法?
-
4696
-
2018-05-17 17:02:52
-
2018-05-19 16:43:52
-
2018-05-18 15:35:20
-
2018-05-15 15:25:13
-
2018-05-25 09:36:09
-
2018-05-18 14:52:18
-
2018-05-28 14:45:27
- sqoop client java api将mysql的数据导到hdfs
- ``` package com.hadoop.recommend; import org.apache.sqoop.client.SqoopClient; import org.apache.sqoop.model.MDriverConfig; import org.apache.sqoop.model.MFromConfig; import org.apache.sqoop.model.MJob; import org.apache.sqoop.model.MLink; import ...
-
1977
-
2018-05-17 13:39:42