• OS X sqlite reader for Facebook history file?

    From Jolly Roger@21:1/5 to Dudley Brooks on Fri Jul 9 21:08:33 2021
    On 2021-07-09, Dudley Brooks <dbrooks@runforyourlife.org> wrote:
    I would like to find an sqlite reader for Facebook's history file, places.sqlite, and similar files.

    The only one I found only runs in Windows.

    I run Windows in Parallels ... but trying to install the program caused
    some major problems which I haven't yet resolved.

    So I would very much like to find an OS X version.

    I supposed I could just use some standard SQL program ... but then I
    would probably have to use SQL myself to extract the details and get
    them in a from I would like.

    The Windows-based reader I found is specifically tailored to the
    Facebook history file and has various built-in ways to interpret the
    data, save it to other formats, etc.

    So ... does anyone know of an OS X version?

    Thanks.

    A quick web search for "macos sqlite reader" shows a few of them... Are
    those not suitable for you?

    --
    E-mail sent to this address may be devoured by my ravenous SPAM filter.
    I often ignore posts from Google. Use a real news client instead.

    JR

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Dudley Brooks@21:1/5 to All on Fri Jul 9 13:49:16 2021
    I would like to find an sqlite reader for Facebook's history file, places.sqlite, and similar files.

    The only one I found only runs in Windows.

    I run Windows in Parallels ... but trying to install the program caused
    some major problems which I haven't yet resolved.

    So I would very much like to find an OS X version.

    I supposed I could just use some standard SQL program ... but then I
    would probably have to use SQL myself to extract the details and get
    them in a from I would like.

    The Windows-based reader I found is specifically tailored to the
    Facebook history file and has various built-in ways to interpret the
    data, save it to other formats, etc.

    So ... does anyone know of an OS X version?

    Thanks.

    --
    Dudley Brooks, Artistic Director
    Run For Your Life! ... it's a dance company!
    San Francisco

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Dudley Brooks@21:1/5 to Jolly Roger on Fri Jul 9 14:30:54 2021
    Weird. I tried that search and didn't find any!

    Oh! Sorry, I tried "macos firefox history sqlite reader". Too
    specific, I guess.

    I will try the more general search and see if any of those fill the bill.

    Thanks!

    On 7/9/21 2:08 PM, Jolly Roger wrote:

    On 2021-07-09, Dudley Brooks <dbrooks@runforyourlife.org> wrote:

    I would like to find an sqlite reader for Facebook's history file,
    places.sqlite, and similar files.

    The only one I found only runs in Windows.

    I run Windows in Parallels ... but trying to install the program caused
    some major problems which I haven't yet resolved.

    So I would very much like to find an OS X version.

    I supposed I could just use some standard SQL program ... but then I
    would probably have to use SQL myself to extract the details and get
    them in a from I would like.

    The Windows-based reader I found is specifically tailored to the
    Facebook history file and has various built-in ways to interpret the
    data, save it to other formats, etc.

    So ... does anyone know of an OS X version?

    Thanks.

    A quick web search for "macos sqlite reader" shows a few of them... Are
    those not suitable for you
    --
    Dudley Brooks, Artistic Director
    Run For Your Life! ... it's a dance company!
    San Francisco

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Lewis@21:1/5 to Dudley Brooks on Fri Jul 9 23:00:24 2021
    In message <scacoe$ts1$1@dont-email.me> Dudley Brooks <dbrooks@runforyourlife.org> wrote:
    I would like to find an sqlite reader for Facebook's history file, places.sqlite, and similar files.

    I am not sure what you mean, sqlite3 is part of macOS and you can easily
    use it to run SQL queries agains the databse and pretty much do whatever
    you want.

    /usr/bin/sqlite3

    #v+
    sqlite3 com.plexapp.plugins.library.db << ENDQUERY
    SELECT
    metadata_items.title,
    metadata_items.added_at,
    cast(ROUND(metadata_items.rating) as integer),
    cast(ROUND(metadata_items.audience_rating) as integer),
    metadata_items.year, guid,
    metadata_items.originally_available_at, height,
    video_codec, media_parts.size
    FROM metadata_items
    JOIN
    media_parts,
    media_items
    WHERE
    metadata_items.library_section_id=2
    AND metadata_items.id=media_items.metadata_item_id
    AND media_items.id=media_parts.media_item_id
    AND media_parts.size>"200000000"
    AND video_codec="hevc" AND height>"1200" ;
    ENDQUERY
    #v-

    Works just fine and returns all the 4K HEVC files in the database.

    So I would very much like to find an OS X version.

    I supposed I could just use some standard SQL program ... but then I
    would probably have to use SQL myself to extract the details and get
    them in a from I would like.

    that is how databases normally work, yes. You could also simply dump the entire database to a text file and find whatever info you are looking for.

    The Windows-based reader I found is specifically tailored to the
    Facebook history file and has various built-in ways to interpret the
    data, save it to other formats, etc.

    Yes, a tool to interact with a database needs to know how the database is formatted and setup, otherwise you need to do the SQL queries on your own.

    So ... does anyone know of an OS X version?

    #NeverFacebook

    However, SQL is pretty straightforward. The hardest part will be figuring out what bullshit Facebook has done to obfuscate the way the link the data.


    --
    Whoever had created humanity had left in a major design flaw. It was
    its tendency to bend at the knees. --Feet of Clay

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Jolly Roger@21:1/5 to Lewis on Sat Jul 10 03:49:55 2021
    On 2021-07-09, Lewis <g.kreme@kreme.dont-email.me> wrote:
    In message <scacoe$ts1$1@dont-email.me> Dudley Brooks <dbrooks@runforyourlife.org> wrote:
    I would like to find an sqlite reader for Facebook's history file,
    places.sqlite, and similar files.

    I am not sure what you mean, sqlite3 is part of macOS and you can easily
    use it to run SQL queries agains the databse and pretty much do whatever
    you want.

    /usr/bin/sqlite3

    #v+
    sqlite3 com.plexapp.plugins.library.db << ENDQUERY
    SELECT
    metadata_items.title,
    metadata_items.added_at,
    cast(ROUND(metadata_items.rating) as integer),
    cast(ROUND(metadata_items.audience_rating) as integer),
    metadata_items.year, guid,
    metadata_items.originally_available_at, height,
    video_codec, media_parts.size
    FROM metadata_items
    JOIN
    media_parts,
    media_items
    WHERE
    metadata_items.library_section_id=2
    AND metadata_items.id=media_items.metadata_item_id
    AND media_items.id=media_parts.media_item_id
    AND media_parts.size>"200000000"
    AND video_codec="hevc" AND height>"1200" ;
    ENDQUERY
    #v-

    Works just fine and returns all the 4K HEVC files in the database.

    Yeah, I didn't bother mentioning that and figured he was looking for a
    generic GUI SQLite app that would automate it.

    --
    E-mail sent to this address may be devoured by my ravenous SPAM filter.
    I often ignore posts from Google. Use a real news client instead.

    JR

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Lewis@21:1/5 to Jolly Roger on Sat Jul 10 15:04:40 2021
    In message <iksjn3FpaepU1@mid.individual.net> Jolly Roger <jollyroger@pobox.com> wrote:
    On 2021-07-09, Lewis <g.kreme@kreme.dont-email.me> wrote:
    In message <scacoe$ts1$1@dont-email.me> Dudley Brooks <dbrooks@runforyourlife.org> wrote:
    I would like to find an sqlite reader for Facebook's history file,
    places.sqlite, and similar files.

    I am not sure what you mean, sqlite3 is part of macOS and you can easily
    use it to run SQL queries agains the databse and pretty much do whatever
    you want.

    /usr/bin/sqlite3

    #v+
    sqlite3 com.plexapp.plugins.library.db << ENDQUERY
    SELECT
    metadata_items.title,
    metadata_items.added_at,
    cast(ROUND(metadata_items.rating) as integer),
    cast(ROUND(metadata_items.audience_rating) as integer),
    metadata_items.year, guid,
    metadata_items.originally_available_at, height,
    video_codec, media_parts.size
    FROM metadata_items
    JOIN
    media_parts,
    media_items
    WHERE
    metadata_items.library_section_id=2
    AND metadata_items.id=media_items.metadata_item_id
    AND media_items.id=media_parts.media_item_id
    AND media_parts.size>"200000000"
    AND video_codec="hevc" AND height>"1200" ;
    ENDQUERY
    #v-

    Works just fine and returns all the 4K HEVC files in the database.

    Yeah, I didn't bother mentioning that and figured he was looking for a generic GUI SQLite app that would automate it.

    Are there general purpose apps that just magically parse a database?
    Seems to me they would need to be customized for the specific database
    to be at all useful.

    Something that understood the plex database and let you really muck
    around in it without writing queries might be kind of cool, but I am not
    going to write it (especially since they keep changing the database
    format).

    --
    Your letters they all say that you're beside me now. Then why do I
    feel alone? I'm standing on a ledge and your fine spider web Is
    fastening my ankle to a stone.

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Dudley Brooks@21:1/5 to Lewis on Sat Jul 10 11:12:28 2021
    On 7/10/21 8:04 AM, Lewis wrote:

    In message <iksjn3FpaepU1@mid.individual.net> Jolly Roger <jollyroger@pobox.com> wrote:

    On 2021-07-09, Lewis <g.kreme@kreme.dont-email.me> wrote:

    In message <scacoe$ts1$1@dont-email.me> Dudley Brooks <dbrooks@runforyourlife.org> wrote:

    I would like to find an sqlite reader for Facebook's history file, places.sqlite, and similar files.

    I am not sure what you mean, sqlite3 is part of macOS and you can easily use it to run SQL queries agains the databse and pretty much do whatever you want.

    /usr/bin/sqlite3

    #v+
    sqlite3 com.plexapp.plugins.library.db << ENDQUERY
    SELECT
    metadata_items.title,
    metadata_items.added_at,
    cast(ROUND(metadata_items.rating) as integer),
    cast(ROUND(metadata_items.audience_rating) as integer),
    metadata_items.year, guid,
    metadata_items.originally_available_at, height,
    video_codec, media_parts.size
    FROM metadata_items
    JOIN
    media_parts,
    media_items
    WHERE
    metadata_items.library_section_id=2
    AND metadata_items.id=media_items.metadata_item_id
    AND media_items.id=media_parts.media_item_id
    AND media_parts.size>"200000000"
    AND video_codec="hevc" AND height>"1200" ;
    ENDQUERY
    #v-

    Works just fine and returns all the 4K HEVC files in the database.

    Yeah, I didn't bother mentioning that and figured he was looking for a generic GUI SQLite app that would automate it.

    Are there general purpose apps that just magically parse a database? Seems to me they would need to be customized for the specific database to be at all useful.

    The Windows one I found was, indeed, customized that way. That's why I
    was hoping to find a similar MacOS one.

    Something that understood the plex database and let you really muck around in it without writing queries might be kind of cool, but I am not going to write it (especially since they keep changing the database format).

    That's a good point! I'm writing this using Thunderbird, and even
    though Mozilla doesn't (I think) do the kind of corporate-proprietary
    things that Facebook does, still I notice that many of the developers of plugins for it eventually get tired of constantly revising their plugins
    to keep up with changes.


    --
    Dudley Brooks, Artistic Director
    Run For Your Life! ... it's a dance company!
    San Francisco

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Dudley Brooks@21:1/5 to Lewis on Sat Jul 10 11:00:15 2021
    On 7/9/21 4:00 PM, Lewis wrote:

    In message <scacoe$ts1$1@dont-email.me> Dudley Brooks <dbrooks@runforyourlife.org> wrote:

    I would like to find an sqlite reader for Facebook's history file, places.sqlite, and similar files.

    I am not sure what you mean, sqlite3 is part of macOS and you can easily use it to run SQL queries agains the databse and pretty much do whatever you want.

    /usr/bin/sqlite3

    #v+
    sqlite3 com.plexapp.plugins.library.db << ENDQUERY
    SELECT
    metadata_items.title,
    metadata_items.added_at,
    cast(ROUND(metadata_items.rating) as integer),
    cast(ROUND(metadata_items.audience_rating) as integer),
    metadata_items.year, guid,
    metadata_items.originally_available_at, height,
    video_codec, media_parts.size
    FROM metadata_items
    JOIN
    media_parts,
    media_items
    WHERE
    metadata_items.library_section_id=2
    AND metadata_items.id=media_items.metadata_item_id
    AND media_items.id=media_parts.media_item_id
    AND media_parts.size>"200000000"
    AND video_codec="hevc" AND height>"1200" ;
    ENDQUERY
    #v-

    Works just fine and returns all the 4K HEVC files in the database.

    So I would very much like to find an OS X version.

    I supposed I could just use some standard SQL program ... but then I would probably have to use SQL myself to extract the details and get them in a from I would like.

    that is how databases normally work, yes. You could also simply dump the entire database to a text file and find whatever info you are looking for.

    Doesn't it include a lot of non-text stuff because of being .sqlite?

    The Windows-based reader I found is specifically tailored to the Facebook history file and has various built-in ways to interpret the data, save it to other formats, etc.

    Yes, a tool to interact with a database needs to know how the database is formatted and setup, otherwise you need to do the SQL queries on your own.

    So ... does anyone know of an OS X version?

    #NeverFacebook

    However, SQL is pretty straightforward.

    Yes, there was a time when I would have enjoyed learning a little SQL
    and figuring out (or asking!) how to to what you show above ... plus how
    to export it into other forms. I just don't have the leisure anymore

    But thanks for supplying the above. And, especially, thanks for letting
    me know that SQLite is included.

    I'll probably still search for readers, just to see if any of them are
    already configured to do exactly what I want.

    The hardest part will be figuring out
    what bullshit Facebook has done to obfuscate the way the link the data.

    Yep, I rather imagine so! That would have been a nice thing about the dedicated Facebook History SQLite Reader.


    --
    Dudley Brooks, Artistic Director
    Run For Your Life! ... it's a dance company!
    San Francisco

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Dudley Brooks@21:1/5 to Jolly Roger on Sat Jul 10 11:04:26 2021
    On 7/9/21 8:49 PM, Jolly Roger wrote:

    On 2021-07-09, Lewis <g.kreme@kreme.dont-email.me> wrote:

    In message <scacoe$ts1$1@dont-email.me> Dudley Brooks <dbrooks@runforyourlife.org> wrote:

    I would like to find an sqlite reader for Facebook's history file, places.sqlite, and similar files.

    I am not sure what you mean, sqlite3 is part of macOS and you can easily use it to run SQL queries agains the databse and pretty much do whatever you want.

    /usr/bin/sqlite3

    #v+
    sqlite3 com.plexapp.plugins.library.db << ENDQUERY
    SELECT
    metadata_items.title,
    metadata_items.added_at,
    cast(ROUND(metadata_items.rating) as integer),
    cast(ROUND(metadata_items.audience_rating) as integer),
    metadata_items.year, guid,
    metadata_items.originally_available_at, height,
    video_codec, media_parts.size
    FROM metadata_items
    JOIN
    media_parts,
    media_items
    WHERE
    metadata_items.library_section_id=2
    AND metadata_items.id=media_items.metadata_item_id
    AND media_items.id=media_parts.media_item_id
    AND media_parts.size>"200000000"
    AND video_codec="hevc" AND height>"1200" ;
    ENDQUERY
    #v-

    Works just fine and returns all the 4K HEVC files in the database.

    Yeah, I didn't bother mentioning that and figured he was looking for a generic GUI SQLite app that would automate it.

    Quite right. Thanks!


    --
    Dudley Brooks, Artistic Director
    Run For Your Life! ... it's a dance company!
    San Francisco

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From nospam@21:1/5 to g.kreme@kreme.dont-email.me on Sat Jul 10 14:18:10 2021
    In article <slrnsejdo8.2iu1.g.kreme@m1mini.local>, Lewis <g.kreme@kreme.dont-email.me> wrote:


    Are there general purpose apps that just magically parse a database?
    Seems to me they would need to be customized for the specific database
    to be at all useful.

    they do if you have the database schema.

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Jolly Roger@21:1/5 to Lewis on Sat Jul 10 23:51:57 2021
    On 2021-07-10, Lewis <g.kreme@kreme.dont-email.me> wrote:
    In message <iksjn3FpaepU1@mid.individual.net> Jolly Roger <jollyroger@pobox.com> wrote:
    On 2021-07-09, Lewis <g.kreme@kreme.dont-email.me> wrote:
    In message <scacoe$ts1$1@dont-email.me> Dudley Brooks <dbrooks@runforyourlife.org> wrote:
    I would like to find an sqlite reader for Facebook's history file,
    places.sqlite, and similar files.

    I am not sure what you mean, sqlite3 is part of macOS and you can easily >>> use it to run SQL queries agains the databse and pretty much do whatever >>> you want.

    /usr/bin/sqlite3

    [snip]

    Works just fine and returns all the 4K HEVC files in the database.

    Yeah, I didn't bother mentioning that and figured he was looking for a
    generic GUI SQLite app that would automate it.

    Are there general purpose apps that just magically parse a database?

    Sure, there are various general purpose database browser apps, for both
    MySQL as well as SQLite. I use MySQL Workbench, DB Browser for SQLite,
    and others regularly for that purpose.

    Seems to me they would need to be customized for the specific database
    to be at all useful.

    Not really. Most of them let you execute SQL commands interactively and
    do other DB operations in an automated fashion, often without needing to
    run any SQL commands directly.

    Something that understood the plex database and let you really muck
    around in it without writing queries might be kind of cool, but I am not going to write it (especially since they keep changing the database
    format).

    I haven't ever bothered looking at the Plex database before, but I just
    opened it in DB Browser without issue:

    <https://imgur.com/a/qS5vVW4>

    --
    E-mail sent to this address may be devoured by my ravenous SPAM filter.
    I often ignore posts from Google. Use a real news client instead.

    JR

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Lewis@21:1/5 to Jolly Roger on Sun Jul 11 09:30:14 2021
    In message <ikuq4tF7d33U1@mid.individual.net> Jolly Roger <jollyroger@pobox.com> wrote:
    On 2021-07-10, Lewis <g.kreme@kreme.dont-email.me> wrote:
    In message <iksjn3FpaepU1@mid.individual.net> Jolly Roger <jollyroger@pobox.com> wrote:
    On 2021-07-09, Lewis <g.kreme@kreme.dont-email.me> wrote:
    In message <scacoe$ts1$1@dont-email.me> Dudley Brooks <dbrooks@runforyourlife.org> wrote:
    I would like to find an sqlite reader for Facebook's history file,
    places.sqlite, and similar files.

    I am not sure what you mean, sqlite3 is part of macOS and you can easily >>>> use it to run SQL queries agains the databse and pretty much do whatever >>>> you want.

    /usr/bin/sqlite3

    [snip]

    Works just fine and returns all the 4K HEVC files in the database.

    Yeah, I didn't bother mentioning that and figured he was looking for a
    generic GUI SQLite app that would automate it.

    Are there general purpose apps that just magically parse a database?

    Sure, there are various general purpose database browser apps, for both
    MySQL as well as SQLite. I use MySQL Workbench, DB Browser for SQLite,
    and others regularly for that purpose.

    Seems to me they would need to be customized for the specific database
    to be at all useful.

    Not really. Most of them let you execute SQL commands interactively and
    do other DB operations in an automated fashion, often without needing to
    run any SQL commands directly.

    Something that understood the plex database and let you really muck
    around in it without writing queries might be kind of cool, but I am not
    going to write it (especially since they keep changing the database
    format).

    I haven't ever bothered looking at the Plex database before, but I just opened it in DB Browser without issue:

    <https://imgur.com/a/qS5vVW4>

    that's not really any different than opening the datbase from the
    command line, is it? It doesn't look like it is relly showing you the
    data relationships. If you open a specific title is it pulling in all
    the info from all the tables to show every bit of information there is associated with that title, or is it just the equivalent of dumping that
    record our of one table and you have to figure out the connections
    yourself?


    --
    2 is not equal to 3, not even for large values of 2. Grabel's Law

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Jolly Roger@21:1/5 to Lewis on Sun Jul 11 16:46:28 2021
    On 2021-07-11, Lewis <g.kreme@kreme.dont-email.me> wrote:
    In message <ikuq4tF7d33U1@mid.individual.net> Jolly Roger <jollyroger@pobox.com> wrote:
    On 2021-07-10, Lewis <g.kreme@kreme.dont-email.me> wrote:
    In message <iksjn3FpaepU1@mid.individual.net> Jolly Roger <jollyroger@pobox.com> wrote:
    On 2021-07-09, Lewis <g.kreme@kreme.dont-email.me> wrote:
    In message <scacoe$ts1$1@dont-email.me> Dudley Brooks <dbrooks@runforyourlife.org> wrote:
    I would like to find an sqlite reader for Facebook's history file, >>>>>> places.sqlite, and similar files.

    I am not sure what you mean, sqlite3 is part of macOS and you can easily >>>>> use it to run SQL queries agains the databse and pretty much do whatever >>>>> you want.

    /usr/bin/sqlite3

    [snip]

    Works just fine and returns all the 4K HEVC files in the database.

    Yeah, I didn't bother mentioning that and figured he was looking
    for a generic GUI SQLite app that would automate it.

    Are there general purpose apps that just magically parse a database?

    Sure, there are various general purpose database browser apps, for
    both MySQL as well as SQLite. I use MySQL Workbench, DB Browser for
    SQLite, and others regularly for that purpose.

    Seems to me they would need to be customized for the specific
    database to be at all useful.

    Not really. Most of them let you execute SQL commands interactively
    and do other DB operations in an automated fashion, often without
    needing to run any SQL commands directly.

    Something that understood the plex database and let you really muck
    around in it without writing queries might be kind of cool, but I am
    not going to write it (especially since they keep changing the
    database format).

    I haven't ever bothered looking at the Plex database before, but I
    just opened it in DB Browser without issue:

    <https://imgur.com/a/qS5vVW4>

    that's not really any different than opening the datbase from the
    command line, is it?

    You can see all of the tables and so on visually without entering any
    commands, which is what the OP wanted.

    It doesn't look like it is relly showing you the data relationships.
    If you open a specific title is it pulling in all the info from all
    the tables to show every bit of information there is associated with
    that title, or is it just the equivalent of dumping that record our of
    one table and you have to figure out the connections yourself?

    I never said it was doing what you're suggesting, and I don't think the
    OP was asking for that either. He simply asked for a SQLite reader app.
    That's what this is.

    --
    E-mail sent to this address may be devoured by my ravenous SPAM filter.
    I often ignore posts from Google. Use a real news client instead.

    JR

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)
  • From Andre@21:1/5 to Dudley Brooks on Mon Jul 12 07:17:22 2021
    On 9 Jul 2021 at 22:49:16 CEST, "Dudley Brooks" wrote:

    I would like to find an sqlite reader for Facebook's history file, places.sqlite, and similar files.

    So ... does anyone know of an OS X version?

    Thanks.

    Valentina supports SQLite and runs under MacOS.

    <https://www.valentina-db.com/en/download-valentina-studio/current>

    Free license:

    <https://www.valentina-db.com/en/get-free-valentina-studio>

    --
    Thanks,
    Andre

    --- SoupGate-Win32 v1.05
    * Origin: fsxNet Usenet Gateway (21:1/5)