Insane Minecraft Hack: Auto Fishing with OCR! No Redstone!

Hey everybody Dave here today we are going to do something very different from normal I play Minecraft on our Realms in Minecraft Java with my family so that’s my wife and my son sometimes there are activities are just super boring you need to grind for something

You need to do something over and over again and there are certain aspects that you could automate there’s various ways to do this I chose to sort of combine two things that I enjoy one is power automate desktop and the other is Minecraft and and use them together in

Just a slightly funny way and this is pretty easy to do so you could build this along with me if you’d like in just a little bit I’m going to show you how to build it from scratch it’s not that difficult but I’m going to show every

Single step just so that you have something to follow in case you’re not familiar with Minecraft maybe I should start with showing you fishing in Minecraft so I have a fishing rod that has the maximum enchantments that help you to catch fish faster basically and

What I’m going to do is right click and it throws out a bobber and it’ll sit here and eventually you’re going going to see some splashing happening and it’ll let it kind of make its way toward the bobber so there it is you see that that splashing and then I can right

Click and pull in a fish let me do that again and I’ll want you to actually notice the little splashes that happens that makes its way toward the bobber because that’s sort of important here and uh it’s kind of random how long it takes there it is okay and then I can

Right click and it pulls in the fish that time I got string okay now from here how do you automate this well there’s there’s Auto Fishers that exist out there you can use an auto clicker that will just click click click click and then you build this sort of

Structure in Minecraft that takes advantage of of bugs or exploits in the game or or just takes advantage of game mechanics in order to trigger you being able to automatically fish and it’s raining again why why is he doing this to me okay it’s not raining anymore all right so there are

Other ways to automate fishing in Minecraft but I want to be clear that most of those ways eventually will break and I think if you’ve ever looked this up you’d find that uh eventually Auto Fishing Concepts or mechanics or you know uh constructs or whatever will all break eventually because Microsoft will

Or Mojang will try to patch it in this situation though there’s virtually no way it’s ever going to be patched and it will always work it involves using accessibility settings so go into your settings by hitting Escape for me on the keyboard I go to options and then

Accessibility settings and then on the top right here show subtitles I’m going to turn that on and then I’m going to hit escape to go back out and now whenever I right click you’re going to see on the bottom right subtitles to sort of indicate the sounds

That are occurring right now and so I can take advantage of that in this case so there whenever you have one of those little fish the little splashing come up to your bobber and grab on the bobber and pull it under water you’ll see it show on the right side just kid’s about

To happen fishing bobber splashes okay we can use that so we go into power automate again I’m going to show you how to do this later I’m just going to hit run on this and then I’m just going to throw the bobber out once and it’s going to sit

There and check you can see it kind of flashing over on the left side I just pointed at my screen as if you can see me pointing eventually though it’s going to see that text pop up and it should trigger a right click okay I haven’t

Touched the key of my mouse at all it’s going to wait a few seconds and then it throws the bobber back out again so now I’m just taking my hands off just want to prove because this doesn’t approve anything somebody else could be controlling my mouse for me

And then it should throw the bobber back out again Isn’t that cool it’s still it doesn’t matter how many times I automate something it still impresses me when something like that works okay so I’m gonna go ahead and stop this though and I want to show you how to build this

Yourself so I’m going to actually build this same flow I want to keep this kind of simple I have a tendency if you’ve never watched me before I have a tendency to go off on a tangent and just build all kinds of things and make it unnecessarily robust

So I’m going to create a new flow and we’re just going to mimic the same things that I made in that flow you can follow it yourself if you want so Auto fishing two so I’m going to name my flow I should go ahead and stop here and say

If you haven’t used power automate desktop before you may be like what in the world is this program that I’m using and how do I get it well this is a free application if you go into the Microsoft store on your computer sometimes it’s called the Windows store Microsoft store

Go in and search for Power automate and you’ll see this icon right here that’s the power automate icon and then you can click for you it’ll say like get and you can click get it’ll take a minute to install and then you open it you will need a Microsoft account to log

In but it can be any Microsoft account and if you don’t have one then you can Microsoft will create one for you based on a Gmail account or whatever so it’s really easy to get right here you just install that and then open it log into it with your Microsoft account you

Should see something similar to the screen that I have above it might look a little different but it should look basically the same click new flow you can name it whatever you want I named mine Minecraft Auto fishing too if I click create first thing that I’m going to do is

Something not 100 necessary but I’m going to just use a weight command or a weight what do we call these in this tool an action I’ve definitely used this tool before okay let’s bring the weight action over I’m going to put uh five seconds into it

Save this is going to give us a little bit of time before it actually starts running in case we decide to do anything like right click right away or something like that and then the next thing I’m going to do is create an infinite Loop there’s multiple ways you could do this

But I’m just going to put an infinite Loop by typing the word Loop grab this Loop condition action and then we’re just going to put one equals one because I think that’s funny and the goal of this is we want to Loop inside this just Forever Until I stop the flow

The primary action that we need to make this happen is going to be OCR bring over if text on screen OCR stands for optical character recognition so that’s kind of like interpreting images as text so if you had a picture of a word then you want to

Be able to interpret that picture as a word that’s what we’re going for because we see sort of text and buttons with text on them inside of Minecraft we want to interpret it as text and then be able to do something with it or make decisions based upon it if text exists

OCR engine Windows OCR engine this is better than tester act text defined uh I can’t actually remember the text so let’s go right click and I’m going to wait for the fish to come grab the bobber and I’m just going to watch to see what the text is on the screen on

The bottom right fishing bobber splashes the f is capital the B is capital the S is not so fishing fishing bobber splashes let’s type here fishing bobber splashes and then it’s not a regular expression the search to text okay so search for text on I’m going to choose foreground

Window because I would imagine that’s going to be a little more performance so it only needs to search inside of the foreground window whatever is in the front but you could probably do entire screen and then the other thing you could do if you wanted to make this a little better

Is you could key in on a specific part of the window or a specific part of the screen by using this however we’re going to make this easy and just go with whole of specified source that means the entire foreground window so whatever window I click on it is going to look

Inside of that while this is running to look for fishing bobber splashes and then do something I’m gonna probably not change any other values in here we’re gonna go save the last part is super simple we’re gonna do send Mouse click drop that in here let’s let’s choose

Right click because uh just in Minecraft when you fish you’re doing you send a right click in order to um send the bobber out so cast it out and then also to reel it in so let’s um do mouse event to send as a right

Click we don’t want to wait any time we want to immediately do it we don’t need to move the mouse let’s save and then let’s copy and duplicate this stage I just did Ctrl C Ctrl V and then in here I want to also put a

Weight so I’m going to copy this weight stage all right I call it a stage this is an action a blue prism terminology coming out and then uh I think I want to do this for four seconds and that’s just the amount of time that I have found when I right click

Okay we’ll wait for a fish to come and then what I want you to watch for is how long does the text stay on the screen so fishing Bob or splashes so it’s about four seconds and or at the very least it’s it’s less than four seconds

I just don’t understand why it wants to rain so much it really wants to rain and then we’re gonna go back over here so wait five seconds wait five seconds and then Loop forever and in that Loop you want to check to see if the text fishing bobber splashes

Exists in the foreground window so the foreground window could be this one that’s the foreground window foreground window could be this one right whatever you have clicked into right then right click immediately so that should reel it in and then wait four seconds and then send out the bobber again or

Cast it out and then it should come back up and it should uh check to see if it’s on screen now it’s going to Loop over and over and over again like really fast I’m going to change the Run delay to one second and uh

Something to note is that you need to be careful about this fishing bobber splashes exists I put this weight here because it gives me time to go click over into this window if I tried to run this without the weight it would see the words fishing bobber splashes inside of power automate

Desktops window that would satisfy the condition and it would go in and it would start right-clicking and stuff so uh we can actually save this let’s make the window smaller I don’t know if this is going to work right let’s see yeah I’m trying to hide fishing bobber splashes

There we will that work so I want to hide fishing Bob or splashes so it doesn’t see itself ever just to make sure and then we’re going to run this I’m going to click over here hit escape and then I’m just going to right click I’m gonna let it sit there

And you can see Power automate is looping on the left side there we go it saw the text reel it in and then it waits four seconds throws that out again and now it’s going to wait for that text again and there we go we got ourselves another

Fish now we can go get a coffee go take a nap you know whatever we need to do I don’t know why coffee is always a thing that uh you go do during a break when something is doing your work for you but it just seems appropriate

Okay we’ll let it go a few times here a couple things to note you can run power automate desktop without this window on the left so I’m gonna let it throw out here for a second I just want to point out this window you don’t have to have this open you can

Close it and I’ll show you how to run it from the console in a second in case you never use power automate desktop before but uh go ahead and stop this now I’m going to hit stop I’m going to close this and then here’s the console these are both exactly the

Same but I’ll run the one we just used but I click run obviously there’s that four seconds that it’s waiting I’m going to click over here right click just to throw it out the first time and now it should do the same thing as it has been doing except this time it

Technically runs faster when it’s in run from the console like this and so it’s going to be more performance something you could encounter depending on the performance of your computer is that uh it may not trigger the right click fast enough to pick up the fish

Now and then because I have found that if I let this sit here for a while it is possible that now and then like right here it may not right click fast enough to get the fish and I think one of the ways you can solve that is by making

Your windows smaller so you can see that I just I don’t have this full screen if I were to make it full screen I think that the optical character recognition would go maybe a little too slow sometimes it wouldn’t always catch the fish fast enough you have kind of like a

Small window in which you need to hurry up and right click but that’s it that’s how you can automate fishing in Minecraft in literally any version of Minecrafts and it should always work as long as sound captions or subtitles are turned on and as long as they continue to support that

But since it’s an accessibility feature for people who have a hard time uh hearing they can read the text on screen I don’t think that Microsoft is going to get rid of that accessibility feature anytime soon because that would be messed up it should be there forever so

You can always Auto fish in Minecraft thanks so much for watching and I’ll see you in the next video