Having just updated my disc image following release of a Service Pack by R-Comp, I've realised that my disc image is something of a mess. with a
number of nominally duplicate files scattered around.

I'm sure I used to have some software that would search through
files/folders and flag up any duplicates, but can't remember what it was
called (if it actually exists!).

I've had a look at my Utilities folder and can't see anything that looks helpful, so if anyone can suggest something, I would be very grateful.
--
Brian Howlett
----------------------------------------------
My net income doesn't cover my gross habits...

--- SoupGate-Win32 v1.05
* Origin: fsxNet Usenet Gateway (21:1/5)

On 7 Dec 2024, [email protected] wrote:

I'm sure I used to have some software that would search through
files/folders and flag up any duplicates, but can't remember what it was called (if it actually exists!).

This was last discussed in Archive Online mailing list in January 2023.

You can start by running Mike Hobbs' !EnumDir (as modified by John
Rickman) to create a file listing all the files in the directory that you
drag in (and all its subdirectories). Then:

Either put the list into a spreadsheet and create a column of just the leafnames (1) and sort the sheet on the leafnames.

Or use a Lua program like the one John Rickman shared, still available
from https://rickman.orpheusweb.co.uk/nolink/jr_dupes.zip (2).

(1) e.g. in Eureka
col A: full pathnames of enumerated filenames
col B: =RIGHT(A1,FIND(".",REVERSE(A1))-1
copied down the column to refer to all A1 to An

(2) I haven't actually tried this but you could contact John for help if needed: rickman at argonet dot co dot uk.

By the way the OS command *EnumDir looks promising but lists ONLY
leafnames and not their location, which doesn't help!

Bernard
--
[email protected]

--- SoupGate-Win32 v1.05
* Origin: fsxNet Usenet Gateway (21:1/5)

On 8 Dec 2024, [email protected] wrote:

(1) e.g. in Eureka
col A: full pathnames of enumerated filenames
col B: =RIGHT(A1,FIND(".",REVERSE(A1))-1
copied down the column to refer to all A1 to An

Oops. Missing close parenthesis. Correction:

(1) e.g. in Eureka
col A: full pathnames of enumerated filenames
col B: =RIGHT(A1,FIND(".",REVERSE(A1))-1)

Bernard

--
[email protected]

--- SoupGate-Win32 v1.05
* Origin: fsxNet Usenet Gateway (21:1/5)

On 8 Dec 2024 as I do recall,
Bernard Boase wrote:

On 7 Dec 2024, [email protected] wrote:

I'm sure I used to have some software that would search through files/folders and flag up any duplicates, but can't remember what it was called (if it actually exists!).

This was last discussed in Archive Online mailing list in January 2023.

You can start by running Mike Hobbs' !EnumDir (as modified by John
Rickman) to create a file listing all the files in the directory that you drag in (and all its subdirectories). Then:

Either put the list into a spreadsheet and create a column of just the leafnames (1) and sort the sheet on the leafnames.

Given the structure of RISC OS applications, aren't you just going to
end up showing vast numbers of (non-duplicate) files with the leafname !Sprites, !RunImage, !Boot, Templates, !Help etc.?

Sorting them on leafname *and* filesize might help, but leafname and
datestamp would seem more foolproof.

--
Harriet Bazley == Loyaulte me lie ==

If you're feeling good, don't worry. You'll get over it.

--- SoupGate-Win32 v1.05
* Origin: fsxNet Usenet Gateway (21:1/5)

On 8 Dec 2024, [email protected] wrote:

On 8 Dec 2024 as I do recall,
Bernard Boase wrote:

Either put the list into a spreadsheet and create a column of just the
leafnames (1) and sort the sheet on the leafnames.

Given the structure of RISC OS applications, aren't you just going to
end up showing vast numbers of (non-duplicate) files with the leafname !Sprites, !RunImage, !Boot, Templates, !Help etc.?

Well, yes, but after sorting, the groups of such common leafnames can be deleted wholesale.

Sorting them on leafname *and* filesize might help, but leafname and datestamp would seem more foolproof.

!EnumDir is written in BASIC, so it should be easy to add datestamps to a comma-separated output list. (I'm not offering!).

Bernard
--
[email protected]

--- SoupGate-Win32 v1.05
* Origin: fsxNet Usenet Gateway (21:1/5)

On 07/12/2024 01:35, Brian Howlett wrote:

Having just updated my disc image following release of a Service Pack by R-Comp, I've realised that my disc image is something of a mess. with a number of nominally duplicate files scattered around.

Keep the image and use !DirSync to scan that and your harddisc. It will
then show you any additional programs on your disc, and you can check to
see if these are duplicated somewhere else in the image.

---druck

--- SoupGate-Win32 v1.05
* Origin: fsxNet Usenet Gateway (21:1/5)

On 9 Dec 2024 as I do recall,
Bernard Boase wrote:

On 8 Dec 2024, [email protected] wrote:

On 8 Dec 2024 as I do recall,
Bernard Boase wrote:

Either put the list into a spreadsheet and create a column of just the
leafnames (1) and sort the sheet on the leafnames.

Given the structure of RISC OS applications, aren't you just going to
end up showing vast numbers of (non-duplicate) files with the leafname !Sprites, !RunImage, !Boot, Templates, !Help etc.?

Well, yes, but after sorting, the groups of such common leafnames can be deleted wholesale.

As I understood it, what was originally wanted was a way of detecting
duplicate items scattered around by R-Comp's Service Pack after their
default locations(?) had changed, which might well include applications
or pseudo-applications (such as all the stuff in Boot:Resources) - in
which case it would be duplicate directory names rather than than the lowest-level leafnames that you would be looking for. My thought was
that viewing the insides of applications wouldn't actually be that
helpful in such a scenario simply because the innards tend to be so
generic....


--
Harriet Bazley == Loyaulte me lie ==

Justice: A decision in your favour.

--- SoupGate-Win32 v1.05
* Origin: fsxNet Usenet Gateway (21:1/5)

In message <[email protected]>
Harriet Bazley <[email protected]> wrote:

On 8 Dec 2024 as I do recall,
Bernard Boase wrote:

On 7 Dec 2024, [email protected] wrote:

I'm sure I used to have some software that would search through files/folders and flag up any duplicates, but can't remember what it was called (if it actually exists!).

This was last discussed in Archive Online mailing list in January 2023.

You can start by running Mike Hobbs' !EnumDir (as modified by John
Rickman) to create a file listing all the files in the directory that you drag in (and all its subdirectories). Then:

Either put the list into a spreadsheet and create a column of just the leafnames (1) and sort the sheet on the leafnames.

Given the structure of RISC OS applications, aren't you just going to
end up showing vast numbers of (non-duplicate) files with the leafname !Sprites, !RunImage, !Boot, Templates, !Help etc.?

Sorting them on leafname *and* filesize might help, but leafname and datestamp would seem more foolproof.

Write two Obey files in same directory

First file "Start" content

| Parameter
| 1 - Output file
| 2 - Directory to check
Create %0
SetType %0 Text
Do <Obey$Dir>.rekursiv %0 <Obey$Dir> %1


Second file "rekursiv" content

| examine subdirectories
repeat "%1.rekursiv %0 %1" %2 -directories
| MD5
|repeat "md5 " %2 -files " { >> %0 }"
repeat "RAM::RamDisc0.$.MD5 " %2 -files " { >> %0 }"

Put MD5 from !Internet.bin into top directory of RAM disc. This is also
a good place for a copy of "Start" and "rekursiv"

Start "Start" inside a task window with outputfile and directory to examine. Actual directory should be that one containing MD5, Start and rekursiv.

You will obtain something like this in the output file.

MD5 (LanMan98::RISCOS.$.!Boot.Resources.!Internet.utils.BootNet) = 9657668abf91ca0f151b39a5af59c4f3
MD5 (LanMan98::RISCOS.$.!Boot.Resources.!Internet.utils.ReadCMOSIP) = ce8ff222112af8397dfefa728e11a842
MD5 (LanMan98::RISCOS.$.!Boot.Resources.!Internet.utils.TriggerCBs) = 1208f0c5e67c22d22912e5d52c6371cd
MD5 (LanMan98::RISCOS.$.!Boot.Resources.!Internet.utils.CheckMem) = ed723224af6b2fc054bf45ab272c536b

Edit the result inside an editor of your choice (Zap, StrongEd).
Replace "MD5 (" by a " and ") = " by a ", or something like this.
Load as CSV file into e.g. FireWorkz and sort by second column (MD5
checksum). In third column you can add a simple formular comparing the
checksum of actual and the following line.

This method is not entirely accurate as different files may have the same MD5 checksum but it is a good selector to find files which are perhaps the same ones. Combining candidates with size and time stamp will improve the result
but I think this isn't necassary.

Regards

Thomas Milius

--- SoupGate-Win32 v1.05
* Origin: fsxNet Usenet Gateway (21:1/5)

In message <5bd2b3cc5b.boase@bernard>
Bernard Boase <[email protected]> wrote:

On 8 Dec 2024, [email protected] wrote:

On 8 Dec 2024 as I do recall,
Bernard Boase wrote:

Either put the list into a spreadsheet and create a column of just the
leafnames (1) and sort the sheet on the leafnames.

Given the structure of RISC OS applications, aren't you just going to
end up showing vast numbers of (non-duplicate) files with the leafname !Sprites, !RunImage, !Boot, Templates, !Help etc.?

Well, yes, but after sorting, the groups of such common leafnames can be deleted wholesale.

Sorting them on leafname *and* filesize might help, but leafname and datestamp would seem more foolproof.

!EnumDir is written in BASIC, so it should be easy to add datestamps to a comma-separated output list. (I'm not offering!).

It's a CLI program, rather than a WIMP app, but you could try "rex".

Basically, it's like the standard *ex command, but recursive - it will
repeat *ex for every directory it finds, optionally excluding
application directories and image filing systems.

You get all the information you would normally get from *ex (so
datstamp, filesize, etc) - and as you can exclude application
directores you won't get lots of !Boot, !Run, etc.

rex is available from
https://tigger.orpheusweb.co.uk/programs/progs.htk, and follow the "Miscellaneous" link. Use SparkFS or similar and drag the rex file to
your Library directory.

--
Nick Roberts tigger @ orpheusinternet.co.uk

Hanlon's Razor: Never attribute to malice that which
can be adequately explained by stupidity.

--- SoupGate-Win32 v1.05
* Origin: fsxNet Usenet Gateway (21:1/5)

In article <[email protected]>,
Nick Roberts <[email protected]> wrote:

rex is available from
https://tigger.orpheusweb.co.uk/programs/progs.htk, and follow the "Miscellaneous" link. Use SparkFS or similar and drag the rex file
to your Library directory.

I think that link should be
https://tigger.orpheusweb.co.uk/programs/progs.html

--
Martin Avison
Note that unfortunately this email address will become invalid
without notice if (when) any spam is received.

--- SoupGate-Win32 v1.05
* Origin: fsxNet Usenet Gateway (21:1/5)

In article <[email protected]>,
Nick Roberts <[email protected]> wrote:

rex is available from
https://tigger.orpheusweb.co.uk/programs/progs.htk,

Or, rather:

https://tigger.orpheusweb.co.uk/programs/progs.html

under Miscellaneous!

John

--- SoupGate-Win32 v1.05
* Origin: fsxNet Usenet Gateway (21:1/5)

In message <[email protected]>
Martin <[email protected]> wrote:

In article <[email protected]>,
Nick Roberts <[email protected]> wrote:

rex is available from
https://tigger.orpheusweb.co.uk/programs/progs.htk, and follow the "Miscellaneous" link. Use SparkFS or similar and drag the rex file
to your Library directory.

I think that link should be https://tigger.orpheusweb.co.uk/programs/progs.html

Quite right. Apologies - I'm using a slightly iffy keyboard ATM.


--
Nick Roberts tigger @ orpheusinternet.co.uk

Hanlon's Razor: Never attribute to malice that which
can be adequately explained by stupidity.

--- SoupGate-Win32 v1.05
* Origin: fsxNet Usenet Gateway (21:1/5)