Network Manager prefers further away AP when there are multiple

Hello, I've been having a problem on Ubuntu which I believe is behavior with Network Manager, I posted a bug first with Ubuntu, and I was directed here https://bugs.launchpad.net/ubuntu/+source/network-manager/+bug/1884008

I'm on Ubuntu 20.04. My Wifi set-up has multiple access points throughout my home, and they all have the same SSID. It doesn't matter where I am in my home though, network manager always connects to one particular AP. If I list all the access points with nmcli dev wifi list I can see that it even picks that one access point if it is the farthest away one:

        76:83:C2:BB:34:2A --              Infra 36 405 Mbit/s 97 ▂▄▆█ WPA2
        74:83:C2:BB:34:2A my_access_point Infra 36 405 Mbit/s 95 ▂▄▆█ WPA2
        74:83:C2:BA:34:2A my_access_point Infra 1 195 Mbit/s 94 ▂▄▆█ WPA2
        76:83:C2:BA:34:2A --              Infra 1 195 Mbit/s 94 ▂▄▆█ WPA2
        B6:FB:E4:45:CA:82 --              Infra 157 405 Mbit/s 44 ▂▄__ WPA2
*       B4:FB:E4:45:CA:82 my_access_point Infra 157 405 Mbit/s 44 ▂▄__ WPA2
        B6:FB:E4:44:CA:82 --              Infra 11 195 Mbit/s 42 ▂▄__ WPA2
        B4:FB:E4:44:CA:82 my_access_point Infra 11 195 Mbit/s 40 ▂▄__ WPA2

It is true that if I change the BSSID field in the wifi settings I can get it to connect to a particular one, but that is not sufficient. I have a laptop, and if I move around my home I need it to connect to the closest one, and switching manually to whichever one is closest is not practical.

I can't even create multiple entries for each BSSID in the list of networks, if I try many different networks appear with the same name and random numbers and I can't even label them.

This is network manager version 1.22.10-1ubuntu2.1