60% agreement rate and poor Wayfarer Rating = JOKE
Qwizical
✭✭✭
Niantic,
You have loads of dedicated Ingress Agents who review for you. We believe in the QUALITY and INTEGRITY of the POI database.
I live in London, but in an area where historically few agents live, and even fewer actively discovered new POI. Subs here don't reach consensus without upgrades (I currently have one on its third day in voting). My oldest sub is from April 17th. 5 of my 10 oldest subs are still in queue.
I currently have 75 subs in the system (41 in queue, 34 in voting) , but every single one of them will need an upgrade if it is to reach a final decision this side of New Years 2021.
I haven't changed how I am rating. And yet you have essentially killed the only way I am going to ever get these portals to full review in a reasonable time.
So many Agents in our Telegram chats are reviewing less or even quitting because there's no point reviewing when something else is out there gaming the system. You are getting fewer reviewers and an even bigger backlog. Releasing Wayfarer to Pokemon Go trainers hasn't made it better. It's made it worse.
Please fix this not just for submitters in city cells, but for every agent who has dedicated days of their life to improving your POI database.
Comments
Absolutely ridiculous how this can happen, I’m hearing so many stories that players have gone from Green to either Yellow or Red just within the last week. Any help appreciated @NianticCasey
Agreed. My rating is 65% and am now in yellow. If it goes to red I will stop reviewing as it’s obviously being outweighed by Pokemon go reviewers giving 5 * to everything from dog **** bins to Supermarket chainstore.
You’re not alone bud… I went down from green to red in 4 days. Now I’m just too afraid to log in Wayfarer again.
People need to stop fear mongering about PoGo players. So much BS is spouted out.
The OP's case may be legit, but I've seen far too many Ingress players lambasting PoGo players only to be revealed later that they reject all kinds of valid submissions because they know it's the opposite team or because they have been reviewing this way forever.
The backlog in many, possibly all places, is up to 4 years. A lot of **** in the system is from Ingress players.
Now, perhaps Niantic shouldn't have released submissions/Wayfarer worldwide at the same time and maybe I'm just "lucky" because we had submissions' popularity die out before Wayfarer came out, but the incessant PoGo hate and elitism has been mostly unfounded.
Furthermore, PoGo players don't get their reviews counted until they hit Green and if they did 5* everything, they would be detected by the algorithm and issued a cooldown.
I don't reject 5* candidates. That's not how I do things. I want there to be more portals for everyone. Its not my fault if you take a rubbish picture or you subbed your mates house or you couldn't get out your car to take a photo.
The supermarket you work at is not a valid portal. This random sign with some words on it with no description is not a valid portal.
I might be harsh in some places but submitters need to understand why their object should be a portal as much as we do.
they reject all kinds of valid submissions because they know it's the opposite team or because they have been reviewing this way forever.
Interesting comparison, my rates are very different than yours, but I'm in a rural area with tons of backlog for good portals (parks, churches, large public commissioned art)
You reject approx 0.45 portals for every one you accept, I'm at 0.25. you duplicate 0.001 portals per accept, I have 0.04. So you are rejecting 2x more frequently but I'm duplicating 40x more frequently. It's definitely geographic, as we have a massive backlog. My agreement rate was at 30% but I've always been in the green simply because we haven't had enough reviewers to get agreements. Since there is a backlog (5 months or more), there are lots of duplicates.
A) Niantic changed the system to stop people downvoting opposition areas ages ago, I’m not saying people don’t try to but if people had been doing that it would have affected their rating before
B) this big change in people’s rating is since PoGo reviewers came in
C) I agree that a lot of the **** in the system is from Ingress players, that isn’t what is being discussed in this thread though
D) this isn’t PoGo hate, it’s pointing out that a large group of new reviewers has come onto the scene and a certain amount of them have realised they have the numbers to manipulate the system, in their words “we outnumber ingress reviewers”
E) you are incorrect on your final point as well, different reviewers votes count differently in relation to their rating, a reviewer in Green counts more than a reviewer in Yellow but if enough people in Yellow 5* something it will outweigh the Green Reviewer who stuck to guidelines
I speak to OP a lot, and I can vouch that she actually works damn hard when it comes to reviewing.
She's been up front and honest with me about any of my submissions she's come across and how she's rate them.
I think it's an absolute joke that she has a great agreement record but she's end up in the red.
They only started counting ‘duplicates’ like a week ago. Everyone’s started at zero. With such a small timeframe you can’t (or at least shouldn’t be) drawing any conclusions about duplicate:reviewed ratios.
I went from Great to Poor and needing to redo the test to reset my rating within 10 mins. I got 3 warnings before this happened, don't know why I got them, one was right after editing and the third was after 1* something within the guys living room.
As @YouLostAStar has already addressed most of your points in a manner that I completely agree with I won't bother to reiterate what they have said.
I will however add that you are also wrong in claiming there is a 4 Year backlog on submissions. We have been told by @RedSoloCup that the backlog was cleared and that any queue is now caused by new submissions only.
We were also advised that if you believe you have any outstanding submissions from the "original backlog" then you need to raise an issue with support as there would be a system problem.
Niantic Support have just told me I need to review the training before I redo the test.
Because apparently it's 100% on me being a bad reviewer and nothing to do with the community reviewing not according the guidelines we followed prior to global Wayfarer release.
Total victim blaming.
I have been reviewing since the 1st day OPR was released to the L16 Ingress agents. I have always been in the green since the afternoon of that release day. Something has changed and I'm sure it's not me. Something has swayed the system away from the consistency we have seen over the last 2 years. If I drop to red, then I'm out. If 67% isn't good enough then, thanks Niantic and I hope you get the database you deserve.
On the topic of backlog.....there is no backlog, From submission day to the POI going live or getting a decision it's averaged 3.5 days for my last 100 Nominations. The system worked, it's all gone to hell in the last week, that's all. Think I will wait it out and start reviewing in a few months.
Stop whining and keep reviewing. If you don't, then don't complain about trash coming through and a triangle not being on your favorite color, because then you lost all rights to do so.
And what are these Accepted to Rejected rates? The half and more rejected. Maybe the problem here is you with a too strict view?
I got one of 2676 to 681 and I can tell that everything I voted positive for was according to the rules. Also agreement rate of 39% and being almost an evergreen. Maybe Germans know how to not constantly nominate trash or are way too lazy to do so. :P I actually read that German PoGo players tend to be stricter than Ingress players. From what I read in my group this even may be true.
Also the trash nominations and troll reviewer will lose interest at some point when they notice stuff doesn't come through.
What a stupid thing to say, we risk losing decent reviewers because their rating is getting trashed by bad reviewers. We review for free, its something we have done to help Niantic because we believed in their vision, the issue here is we care whereas they don’t seem to care about the quality of portals/Pokestops/whatever
I have been tracking my numbers since wayfarer was release and just today I have gone from great (green ) to yellow and as you can see not much has really changed ?!? And why is my recon total bigger than my agreement total ?
WRONG. They counted duplicates all right. They just didn't have a separate heading for them.
Previously, they were lumped in under "Rejected".
I dont want to burst anybodys bubble because apparently everybody is the king of kings regarding to review
but havent you thought that probably after tweaks, improvements, fixes, etc in reality means that you werent as good as you thought and your past even if you have agreement ratio over 60% is affecteing you, and if you dont change some stuff your present will affect your future and will go into red
summary tl:dr you arent as good as you thought and the system ralized that, goes for everbody, now my fans disagree with me because i am smarter than you
maybe if it was just a few people I might be inclined to consider this, however I’ve also seen someone with 75% agreements in the Red, rating is more heavily weighted to recent reviews so the influx of new reviewers has heavily skewed everyone’s rating and it is a common theme that lots of people are going from Green to Red.
Okay so firstly, that is an assumption you are making. I don’t believe Niantic ever clarified in documents or AMAs how ‘duplicates’ fit into the stats previously (whether it counted as ‘accepted’, ‘rejected’ or neither). A caps-lock ‘wrong’ seems way overboard.
Secondly, it is missing the point of my post. The person I was responding to was using the number under ‘Duplicates’ to analyse the voting patterns of the OP. But because this number only started being tracked a week ago (regardless of how it was previously counted) it can’t be relied on as a valid statistic for comparisons. If I marked 10 portals as duplicates in the last week and have previously had 15,000 agreements, and some new user also marked 10 portals as duplicates in the last week and has 150 agreements, percentage-wise it looks like they are 100 times more likely to mark things as duplicates. Whereas, in reality, we’ve marked the same number of duplicates in the week — I’ve just been reviewing longer.
Thanks, didn't know that
Is it noteworthy or just coincidence that the people dropping drastically have such high rejection rates? I mean, dang, thundercracker has a 42.6% rejection rate.
I agree, there's a LOT of stupidity around the influx of rookies, but perhaps there's also the issue of the overly uptight finally being the minority.
From other people’s stats I’ve seen people with low rejection rate have also dropped into poor
My rejection rate is at about 29%, yet I went straight from Great to Poor within one rating session.
The order of these photos are wrong and I can't see how to change them. But it shows a couple of issues that don't make sense.
I have been reviewing for around 15 months and always in green. The other day I dropped to yellow (photo 3). I did no reviews for a couple of hours, and according to the stats received no agreements, yet went back up to green (photo 1). How is this possible from zero agreements?
One day and just 25 reviews later, I dropped from green to red (photo 2). I refuse to believe that in such a short time I received so many disagreements I went from being a great reviewer to poor.
We have contributed so much to the POI network, for the sake of all the games. We've followed guidelines, taught them to others, asked AMA questions that have clarified certain guidelines... and that effort is feeling very unappreciated right now. Many decent reviewers are saying they're going to stop, which will only contribute to more disagreements for others following the guidelines and more agents going into the red.
I'll carry on reviewing and following the guidelines because I still care about high quality POI, and because I want to support others reviewing who are within guidelines and give them a better chance to get agreements. But it's still an insult everytime I load up that screen and it suggests I retake the test.
Please look into this Niantic. You're losing players who have contributed positively to your POI network, and putting off new reviewers who have also been following guidelines and would have been an asset to the Wayfarer Community.
This is what happens when you let masses of people with no idea what they are doing or a complete disregard for the POI network (who are simply chasing more stops or gyms) all review at the same time. They hold the balance of power within the ratings system due to sheer numbers and therefore established reviewers who are following the guidelines are penalised. The new reviewers think they are doing a good job due to their green ratings and continue to accept dog waste bins and garden gnomes. It should have been a phased introduction to reviewing for Pokemon players based on something other than Level 40 (which every man/woman/dog and their multiple accounts seem to be). There should have also been new rules implemented to withhold their influence on the system until they had a strong and consistent alignment with current reviewers. Very reckless and a kick in the face for those that have dedicated time and effort to follow the process correctly. Sad times. RIP POI network.
You have groups of people, be it FB chat, be it Discord, be it whatever, with plenty of l40 accounts, even several per person (with multiaccing being the PoGo norm anywhere I've seen from day one) sending each other their submissions to ensure they go through, begging so that every dust bin, scribbling on the wall or a particularly interesting log are made "stops" or "gyms" because there "are not enough spots in my village" / "we need another gym in the park* etc. And by sheer numbers - they do. I'd managed to go from great to red because I'd one starrred - a 10cm by 10cm tag on some wall that may have been a private residence, a wall riddled with meaningless graffitti, a 1.5m by 1.5m patch of concrete between two benches that someone reported as an "outdoors bowling lane", a couple of store signs in a mall and a part of a generic store sign that someone tried to pass as wall decoration. The rest were mostly 4-5 star reviews of the usual suspects - chapels, playgrounds etc. In the green since day 1 of L16 reviewing on OPR. Gone after 20 reviews on a single day.
I know of several more cases where people who have been reviewing for a while have gone red, even needed to take the test again. In fact, I'm less and less sure there is anyone active unaffected by this. So, in areas where PoGo players are well organized and less scrupulous, older reviewers (plenty of which were PoGo players who made the effort of playing Ingress to get to OPR) are simply ****, and nobody but Niantic is to blame.
It feels like hardly anyone is reviewing now as well. People are quitting as they have gone into poor and there can't be many left in green. My upgrade is on 4.5 days right now which is twice as long as it used to take.
Unless this is resolved soon I'm worried nothing will reach a final decision.
68% agreement rate in an area with 6+ month queue times so way higher if the local backlog were to clear, 8,000 reviews since May, always great since day 3 of reviewing, yet rating dropped from great to good last night then wake up and its poor and telling me to retake a test to reset it............
Nominations Accepted 3079
Nominations Rejected 1663
35% reject rate
Also review from a pogo player perspective and gladly accept anything that justifies meeting some criteria.
From a submitter perspective 250 portals accepted, 50 rejected so an 80% rate there even with trying to ram through iffy safe pogo pre-gyms.
well, my rating went back up to green over night. I think if it suddenly drops to poor, you just need to step away for a bit and let it cool down. Could be going back to the argument of to many reviews in a short amount of time, which still remains a stupid issue because how else does Niantic expect to get this backlog cleaned up? And reviewing is already boring enough, why force players to break from "the zone" when it can be a bother to get back on later to vote again?