Download BigDataBench Simulator Version
Transcript
Handbook of BigDataBench 3.1 39 This command will generate 10 files, in which each contains 100 lines, and each line contains 1000 words by using model wiki1w. Note: The tool needs to install GSL-GNU Scientific Library. Before you run the program, Please make sure that GSL is ready. Your also can choose parallel, mkdir /mnt/raid/BigDataGeneratorSuite in every node Configure NON password login and the host: parallel ex/conf hosts To Run cd parallel ex sh deploy ex.sh sh run textGen .sh Graph Generator Here we use Kronecker to generate data that is both mathematically tractable and have all the structural properties from the real data set. (http://snap.st anford.edu/snap/index.html)In BigDataBench 3.1 we analyze the Google, Facebook and Amazon data sets to generate model. Our graph data generate tool can produce the big data based on the model. Generate the data command fill the name of corresponding data generation tool sh gen kronecker graph Parameters -o:Output graph file name (default:’graph.txt’) -m:Matrix (in Maltab notation) (default:’0.9 0.5; 0.5 0.1’) -i:Iterations of Kronecker product (default:5) -s:Random seed (0 - time seed) (default:0) For example sh gen kronecker graph -o:../data-outfile/amazon gen.txt -m:”0.7196 0.6313; 0.4833 0.3601” -i:23 Note:If you want to recompilation ,you should do this