Skip to content

Check "both are bad" / "tie" votes & consider displaying top-K #31

@Muennighoff

Description

@Muennighoff

Based on this comment: https://x.com/semih__yavuz/status/1819075993576874117

Indeed a lot of times models retrieve the same / both retrieve something poor. Could also be sth where if sb votes Tie / Both are bad then there's an option to display the 2nd (k=2) result or sth (tho will require either re-retrieving or always retrieving k results to begin with). cc @semihyavuzz

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions