Ask HN: How to try out AIML finetuning on a laptop?

6 points by profsummergig a day ago

I want to try out AI/ML finetuning on a laptop.

Nothing too involved. I just want to see the output of the model improve in a couple of hours as I finetune it.

Is there a pre-trained model out there that is small enough to do this? (Ideally something that can be installed via a single Docker-Compose command.)

PLBjt a day ago

Hi, depends on what kind of model you want to fine-tune. Could you be a little more specific?

  • profsummergig a day ago

    I am looking for an aha moment, a eureka moment, where after a bit of finetuning I start to see the model responding.

    It literally doesn't matter to me what exact domain problem is solved.

    I want something that's easy to set up and could produce (at least some verifiable) results in under an hour.

    Some sort of toy problem would be ideal.