Skip to content

Heavy precision problem #133

Description

@NileZhou

Like in lcb_runner/evaluation/testing_util.py

You should change the

if decimal_prediction_line == decimal_gtout_line:

to

if abs(decimal_prediction_line - decimal_gtout_line) < 1e-6:
    continue

I found lots of false negative example while using livecodebench

(so as the grade_stdio method

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions