This directoy contains the micro-benchmark and macro-benchmark.
- For micro-benchmark, we have provided the 135 testing programs in each subdirectories in
micro-benchmark.md. - For macro-benchmark, we have provided the URL for cloning the repositories and the corresponding commit ids when we cloned the repository. We also provided the downloaded repository in
pj
The 135 testing programs are located at:
1 arguments/assigned_call
2 arguments/call
3 arguments/imported_assigned_call
4 arguments/imported_call
5 arguments/nested_call
6 arguments/param_call
7 assignments/chained
8 assignments/recursive_tuple
9 assignments/starred
10 assignments/tuple
11 builtins/functions
12 builtins/map
13 builtins/types
14 classes/assigned_call
15 classes/assigned_self_call
16 classes/base_class_attr
17 classes/base_class_calls_child
18 classes/call
19 classes/direct_call
20 classes/imported_attr_access
21 classes/imported_call
22 classes/imported_call_without_init
23 classes/imported_nested_attr_access
24 classes/instance
25 classes/nested_call
26 classes/nested_class_calls
27 classes/parameter_call
28 classes/return_call
29 classes/return_call_direct
30 classes/self_assign_func
31 classes/self_assignment
32 classes/self_call
33 classes/static_method_call
34 classes/super_class_return
35 classes/tuple_assignment
36 decorators/assigned
37 decorators/call
38 decorators/nested
39 decorators/nested_decorators
40 decorators/param_call
41 decorators/return
42 decorators/return_different_func
43 dicts/add_key
44 dicts/assign
45 dicts/call
46 dicts/ext_key
47 dicts/nested
48 dicts/new_key_param
49 dicts/param
50 dicts/param_key
51 dicts/return
52 dicts/return_assign
53 dicts/type_coercion
54 dicts/update
55 direct_calls/assigned_call
56 direct_calls/imported_return_call
57 direct_calls/return_call
58 direct_calls/with_parameters
59 exceptions/raise
60 exceptions/raise_assigned
61 exceptions/raise_attr
62 functions/assigned_call
63 functions/assigned_call_lit_param
64 functions/call
65 functions/imported_call
66 generators/iter_param
67 generators/iter_return
68 generators/iterable
69 generators/iterable_assigned
70 generators/no_iter
71 generators/yield
72 imports/chained_import
73 imports/import_all
74 imports/import_as
75 imports/import_from
76 imports/init_func_import
77 imports/init_import
78 imports/parent_import
79 imports/relative_import
80 imports/relative_import_with_name
81 imports/simple_import
82 imports/submodule_import
83 imports/submodule_import_all
84 imports/submodule_import_as
85 imports/submodule_import_from
86 kwargs/assigned_call
87 kwargs/call
88 kwargs/chained_call
89 lambdas/call
90 lambdas/calls_parameter
91 lambdas/chained_calls
92 lambdas/parameter_call
93 lambdas/return_call
94 lists/comprehension_if
95 lists/comprehension_val
96 lists/ext_index
97 lists/nested
98 lists/nested_comprehension
99 lists/param_index
100 lists/simple
101 lists/slice
102 mro/basic
103 mro/basic_init
104 mro/parents_same_superclass
105 mro/self_assignment
106 mro/super_call
107 mro/two_parents
108 mro/two_parents_method_defined
109 new_arguments/assign_return
110 new_arguments/class_args
111 new_arguments/class_default_args
112 new_arguments/default_args
113 new_assignments/assign_class
114 new_assignments/assign_function
115 new_assignments/assign_swap
116 new_assignments/assign_variable
117 new_control_flow/elseif
118 new_control_flow/if
119 new_control_flow/ifMain
120 new_control_flow/while
121 new_control_flow/with
122 new_direct calls/class_call
123 new_direct calls/ext_insider_call
124 new_direct calls/external_call
125 new_direct calls/insider_call
126 new_direct calls/insider_ext_call
127 new_imports/chain_import
128 new_imports/import_all
129 new_imports/import_as
130 new_imports/import_same
131 new_imports/init_import
132 returns/call
133 returns/imported_call
134 returns/nested_import_call
135 returns/return_complex