More scholarly junk is trashed than you can imagine. See also RetractionWatch.com.
His idea sounds good but the spoiled egotistical brats of academia won't play nicely. It decays into social media for the highly credentialed. Can't imagine a civil pursuit of truth on anything related to climate or covid or evolution. Nor economics.
A moderator? That will turn out like facebook community standards with its shadowy enforcers and dubious due process. Combined with the vindictiveness of a Tenure Committee.
I think you have been far to kind to the people who have been guilty of 'cooking the books'. They have no right to call themselves scientists. If they are teaching, they should be fired. By itself, that would do much to resolve the issue.
Call me cynical, but I'd say this is a feature and not a bug. This is how you control the narrative by controlling what gets published. The author acts as though this is system that is supposed to function for the benefit of science. I'd say it does it exactly what it is supposed to do and will continue to do so. These people are not interested in truth, or at least in science, which is to disprove, they are interested in control and they have it just the way they like it.
You (the universal you, not the author of this post) can put God in Heaven and Satan in Hell. That seems tidy. But the reality is heaven and hell are between the ears and rib cage of each person. Each research system will be gamed and coopted and corrupted.
It won't matter.
And the vague speciousness of so much of the social science research is justified by astonishinly inept mistreatment of mathematics -- particularly statistics and probability. It's a fucking shit show, frankly. The belief you can adopt the determinism of the physical sciences that started with Newtonian mechanics (or even Gallileo) and apply it whole cloth to human decision making.
NO way. You can fake it. You can show lots of t-stats. You can try to impress with all that.
But really, the very thing you're measuring is human behavior in world systems that are inherently unstable political and social constructs.
And in the physical sciences, where there is rigor, there is so much money and so much politics and so few people who can truly and really understand that it's also hopeless. and it can be really really hard, such as the migration from Newtonian mechanics to relativity to quantum theory. When a "truth" requires that level of deep a priori insight, how universal can it be.
it's a utopian project to systematically find a way to make truth seeking an objective and enforceable framework.
Rob Jenkins' "medieval community of scholars with a 21st-century twist" framing is exactly right, and there's a missing piece: the twist now includes AI-native retrieval, which solves the scaling problem that killed the medieval model in the first place.
I've built a working example: the Kastner Aberdeen Wiki (https://github.com/shorttack/kastner-aberdeen-wiki) — 40+ years of technology research (Aberdeen Group, ~1,400 studies) restructured as a public GitHub corpus with embedded local-LLM retrieval. Time-stamped commits, GitHub-handle attribution, hyperlinked wikilinks, no anonymity, no gatekeeper. Researchers fork, add synthesis notes via PR, respond to existing notes — each contribution citable and permanent.
Two design choices that matter for your framework: contributions require citations (raises the threshold above commentary), and there are no comment threads (engagement happens through citable response notes). The result is a corpus that compounds rather than collapsing into a forum.
Medieval model + AI retrieval = the working version of what you're describing.
This SOUNDS interesting, and possibly workable. Perhaps something like this could also be applied to begin rooting out the execrable bias in much of the Wikipedia content on certain ' "settled" science' oxymoronic topics?
Most of the traditional "universities" have outlived their usefulness as well. Just look at Peterson Academy or Prager U. One hour of Jordan Peterson is probably worth a semester (or more) of some "gender/queer" studies asst. prof. at Harvard.
Today the regime media has created a BS babble speak shorthand for "peer reviewed research." I generally assume everything preceding or following "experts say" should be judged with extreme prejudice.
If the "powers that be" want to silence you , rest assured by hook or by crook , that is exactly what will happen . Perfect example would be 11 or 12 missing scientists/high level defense personnel dead or missing . WTF, over ??? I'm guessing their "peers" did not not like their reviews .
Maybe these fools should simply stop publishing and learn to do something useful. Clearly, their thinking caps are not worth spit and i very much doubt any/many of them would be sufficiently competent for any job beyond cleaning an outhouse.
I have begun to wonder if a good healthy collapse of civilization is the only thing that might fix the "modern" world.
Perhaps thats the meta message behind the the great flood and Noah. Every few thousand years a great flushing might be necessary.
I'm headed off to the outhouse to give that some thought...
Knowing the names of participants puts reputational capital at risk. Peer review usually keeps the reviewer's identity secret from the author. This might introduce some friction to your review and comment model.
I've always believed that reviewers' willingness to serve comes with some opinion baggage, like the people who serve on the School Board. They aren't there entirely out of altruism. They have a burr under their saddle that they want to hand off to you, the author, if your thesis conflicts with their worldview, just as you said.
It's not different from having a discussion at a conference after presenting work. There is no anonymity there. As long as the criticism is well put and constructive, my experience from conferences is that it will be well tolerated.
Like defending a thesis. I get that. But to judge the criticism, assuming it is contradictory, requires some kind of jury doesn't it? Eventually you land at a semi-public critique environment with all the madness that can bring. How else could it be structured?
Right now it's whoever the journal editor thinks is right, interacting with the author and an anonymous reviewer. There's probably no ideal way to get at what is true except to require authors to disclose their data and the manner in which it was acquired. Let anyone who wants to duplicate the research or analyze the data have at it.
If I remember correctly, Heisenberg was very bad at defending his PhD thesis. But it wasn't on quantum mechanics, lol. He passed with just a squeak. At some point, you don't have to judge if it doesn't contain a major logical inconsistency. If it is an important point, people simply remember and see if it replicates at some point.
Good pieces of work like General Relativity or Poincare Conjecture Proof have been replicated extensively. Once they have been published and replicated, no-one would think of publishing it again in a "journal".
So, should we infer that replication is the ultimate solution to this mess actually?
Maybe for theories but for patentable, profit-potential concepts, proof of drug performance, not likely that a Full Journal write-up could be eschewed. Regardless, maybe proof of theory by replication can lead the way into a general protocol that "works" overall.
I think we can all agree that the current academic and journal review system is near worthless at this point. The published "science" is now being fed into the data streams as though it is gospel. I have doubts that, with the advancement of encryption defeating programs, any sort of truth is safe from malfeasance. As bad as the current system is, the same entities that censor and control narratives currently will, most likely, retain their influence irregardless. Wrestling power away from them can only happen through a mass rejection of their narrative and thus their power derived from acceptance.
The review by peers is akin to a cult. Everyone involved is seeking a payoff...money, prestige, acknowledgement, the passing of lies, a higher position, theivery, grifting. Because peers are human, there is no independent thinking or reviewing. No one without an iron in the fire.
More scholarly junk is trashed than you can imagine. See also RetractionWatch.com.
His idea sounds good but the spoiled egotistical brats of academia won't play nicely. It decays into social media for the highly credentialed. Can't imagine a civil pursuit of truth on anything related to climate or covid or evolution. Nor economics.
A moderator? That will turn out like facebook community standards with its shadowy enforcers and dubious due process. Combined with the vindictiveness of a Tenure Committee.
Any moderator can be bought off as can those who are buying off the moderator and so on and so on.
Buying off moderators won't work easily if you have sufficiently clever established researchers which actually lead large groups of 10-60 people.
Have you ever watched discussions at departmental or conference talks?
I think you have been far to kind to the people who have been guilty of 'cooking the books'. They have no right to call themselves scientists. If they are teaching, they should be fired. By itself, that would do much to resolve the issue.
There's the conundrum. Ultimately, fired by us.
Call me cynical, but I'd say this is a feature and not a bug. This is how you control the narrative by controlling what gets published. The author acts as though this is system that is supposed to function for the benefit of science. I'd say it does it exactly what it is supposed to do and will continue to do so. These people are not interested in truth, or at least in science, which is to disprove, they are interested in control and they have it just the way they like it.
🎯
Amen!
You (the universal you, not the author of this post) can put God in Heaven and Satan in Hell. That seems tidy. But the reality is heaven and hell are between the ears and rib cage of each person. Each research system will be gamed and coopted and corrupted.
It won't matter.
And the vague speciousness of so much of the social science research is justified by astonishinly inept mistreatment of mathematics -- particularly statistics and probability. It's a fucking shit show, frankly. The belief you can adopt the determinism of the physical sciences that started with Newtonian mechanics (or even Gallileo) and apply it whole cloth to human decision making.
NO way. You can fake it. You can show lots of t-stats. You can try to impress with all that.
But really, the very thing you're measuring is human behavior in world systems that are inherently unstable political and social constructs.
And in the physical sciences, where there is rigor, there is so much money and so much politics and so few people who can truly and really understand that it's also hopeless. and it can be really really hard, such as the migration from Newtonian mechanics to relativity to quantum theory. When a "truth" requires that level of deep a priori insight, how universal can it be.
it's a utopian project to systematically find a way to make truth seeking an objective and enforceable framework.
Rob Jenkins' "medieval community of scholars with a 21st-century twist" framing is exactly right, and there's a missing piece: the twist now includes AI-native retrieval, which solves the scaling problem that killed the medieval model in the first place.
I've built a working example: the Kastner Aberdeen Wiki (https://github.com/shorttack/kastner-aberdeen-wiki) — 40+ years of technology research (Aberdeen Group, ~1,400 studies) restructured as a public GitHub corpus with embedded local-LLM retrieval. Time-stamped commits, GitHub-handle attribution, hyperlinked wikilinks, no anonymity, no gatekeeper. Researchers fork, add synthesis notes via PR, respond to existing notes — each contribution citable and permanent.
Two design choices that matter for your framework: contributions require citations (raises the threshold above commentary), and there are no comment threads (engagement happens through citable response notes). The result is a corpus that compounds rather than collapsing into a forum.
Medieval model + AI retrieval = the working version of what you're describing.
— Peter S. Kastner, pskastner @ gmail.com
This SOUNDS interesting, and possibly workable. Perhaps something like this could also be applied to begin rooting out the execrable bias in much of the Wikipedia content on certain ' "settled" science' oxymoronic topics?
LOL. Yes, a citable Wikipedia would be an instant cheat sheet to the arguments of every human issue. An advance in civilization.
Most of the traditional "universities" have outlived their usefulness as well. Just look at Peterson Academy or Prager U. One hour of Jordan Peterson is probably worth a semester (or more) of some "gender/queer" studies asst. prof. at Harvard.
Today the regime media has created a BS babble speak shorthand for "peer reviewed research." I generally assume everything preceding or following "experts say" should be judged with extreme prejudice.
If the "powers that be" want to silence you , rest assured by hook or by crook , that is exactly what will happen . Perfect example would be 11 or 12 missing scientists/high level defense personnel dead or missing . WTF, over ??? I'm guessing their "peers" did not not like their reviews .
Maybe these fools should simply stop publishing and learn to do something useful. Clearly, their thinking caps are not worth spit and i very much doubt any/many of them would be sufficiently competent for any job beyond cleaning an outhouse.
I have begun to wonder if a good healthy collapse of civilization is the only thing that might fix the "modern" world.
Perhaps thats the meta message behind the the great flood and Noah. Every few thousand years a great flushing might be necessary.
I'm headed off to the outhouse to give that some thought...
Knowing the names of participants puts reputational capital at risk. Peer review usually keeps the reviewer's identity secret from the author. This might introduce some friction to your review and comment model.
I've always believed that reviewers' willingness to serve comes with some opinion baggage, like the people who serve on the School Board. They aren't there entirely out of altruism. They have a burr under their saddle that they want to hand off to you, the author, if your thesis conflicts with their worldview, just as you said.
Similarly, in politics, the people we should not vote for are the ones who put the most time and money into campaigning.
It's not different from having a discussion at a conference after presenting work. There is no anonymity there. As long as the criticism is well put and constructive, my experience from conferences is that it will be well tolerated.
Like defending a thesis. I get that. But to judge the criticism, assuming it is contradictory, requires some kind of jury doesn't it? Eventually you land at a semi-public critique environment with all the madness that can bring. How else could it be structured?
Right now it's whoever the journal editor thinks is right, interacting with the author and an anonymous reviewer. There's probably no ideal way to get at what is true except to require authors to disclose their data and the manner in which it was acquired. Let anyone who wants to duplicate the research or analyze the data have at it.
If I remember correctly, Heisenberg was very bad at defending his PhD thesis. But it wasn't on quantum mechanics, lol. He passed with just a squeak. At some point, you don't have to judge if it doesn't contain a major logical inconsistency. If it is an important point, people simply remember and see if it replicates at some point.
not a bad idea, but one more tweak is still necessary:
NO paper allowed publishing in a "journal" unless replicated ONCE by a third party.
OR, until replicated and shown to be efficacious, not published with some sort of imprimatur of confidence, making it less than golden.
Good pieces of work like General Relativity or Poincare Conjecture Proof have been replicated extensively. Once they have been published and replicated, no-one would think of publishing it again in a "journal".
So, should we infer that replication is the ultimate solution to this mess actually?
Maybe for theories but for patentable, profit-potential concepts, proof of drug performance, not likely that a Full Journal write-up could be eschewed. Regardless, maybe proof of theory by replication can lead the way into a general protocol that "works" overall.
I think we can all agree that the current academic and journal review system is near worthless at this point. The published "science" is now being fed into the data streams as though it is gospel. I have doubts that, with the advancement of encryption defeating programs, any sort of truth is safe from malfeasance. As bad as the current system is, the same entities that censor and control narratives currently will, most likely, retain their influence irregardless. Wrestling power away from them can only happen through a mass rejection of their narrative and thus their power derived from acceptance.
The review by peers is akin to a cult. Everyone involved is seeking a payoff...money, prestige, acknowledgement, the passing of lies, a higher position, theivery, grifting. Because peers are human, there is no independent thinking or reviewing. No one without an iron in the fire.
Safety = Freedom-less