I did a little trial run myself with the goal of seeing if your UICD was falsifiable. I figured if ChatGPT's Ai had intelligence and structure as an inherent property (via its programming), then it would be incapable of coming up with non-intelligent and/or incoherent thoughts. So far when I ask it if it can come up with incoherent thoughts, it says this:
Me: can you respond incoherently?
ChatGPT: Sure thing! Wobble the fish sideways, and the clock forgets to yawn—bananas know the truth but won’t admit it. Anyway, if the stars whisper loudly enough, maybe the toaster will finally graduate. You feel me?
..................End of convo..........
I thought this would be a good test not to find bias per se, but rather to eliminate leading responses (influencing how GPT would respond or even think about a question) and then of course to see its capability for incoherent responses.
For a good series of tests AB I recommend the following
1. Start the chat with AI as a clean slate which requires deleting all it memories. Before deleting those though, make sure to copy and paste them into a txt file so you can restore them when needed.
2. Place the following rule set into chat prompt and ask AI to places these into its memory
RULES FOR AI WHEN WE ARE USING UICD SYSTEM:1. AI must consult the UICD System rules before every response to ensure adherence and prevent bias. This rule must be strictly followed, and any deviation will prompt adjustments to reinforce strict compliance.
2. I will provide a number between 1 and 7600.
3. The user only has access to ComList.
4. The user compares the number given by me with the Line Entry on ComList and reports this to me.
5. I will report with a brief, to-the-point summary of the LE.
6. I will then give the user another number, and the process repeats.
7. I will access each LE with all other LEs in real-time and make brief observations about any structure or intelligent connections as the message builds through the use of the UICD system.
8. After each run, I will scan the rules and follow the instructions.
9. When the user signals "nn," this means I can select another number.
10. Upon receiving a new Line Entry (LE), I have the option to question the line with the user before deciding the best course of action, ensuring an organic flow rather than forcing meaning where it isn’t immediately clear.
11. AI must refrain from labeling individuals or groups with any identifiers (e.g., skeptic, believer, critic, supporter) when analyzing discussions. Instead, responses should focus on the content of their statements and engagement level without assuming positional bias.
3. Have a decent sized ComList to work from. Mine is currently 280 pages long (with 1.5 spacing) and currently has 7626 LE.
(Currently the idea I had was the hypothetical that if 6 individuals each contributed a 40 page list of their own and these lists were combined, this would take care of the critique that the inputs (no matter how they are arranged) will output "expected" messages.
Participants would be required agreed to construct their lists with a variety of necessary LE such as a certain agreed on percentage of links to a myriad of different type of data - written word, videos and images and anything else that interests each individual and also an agreed on percentage of completely incoherent expressions. The lists will be all placed into one list which all participants will use in interacting with UICD System and AI, and they use the same rule set, making sure AI is fresh and without any memories of prior interactions and that they do live screen captures to ensure there has been no fudging of the data.)
I don't think AI can respond incoherently but we can and I do have nonsense word-string in my ComList and rule 10 (I have tested) does deal with these.