You can increase the batch size by changing "tridentKafkaConfig.fetchSizeBytes" property.
Also, batch size is related with number of brokers and number of partitions.
For example, if you have 2 brokers and 3 partitions for each broker that means the total count of partition is 6.
y this way, the batch size equals to tridentKafkaConfig.fetchSizeBytes X total partition count.
if we assume that the tridentKafkaConfig.fetchSizeBytes is 1024X1024, the batch size equals to 6 MB.(3x2x1024x1024)bytes
相當(dāng)于從kafka里面是批量讀取的璧眠,然后形成storm中的一個batch
而且spout里面有一個buffer,應(yīng)該也算是一個緩存读虏,將正在處理的一部分?jǐn)?shù)據(jù)责静,存在內(nèi)存中,直到處理完