Salient Soft

This follows on from my previous post here.

Addition of a USB extender

As before, the mobile router performed around 4 times faster in the wooden garden office than in the brick build house, so it made sense to locate the router there when in use. However, I still wanted to allow shared internet around the house and on wifi when using the backup, and doing this another way e.g. by trying to share the connection from a windows PC in the garden office was not straightforward, and prevented the features of the Fritz box like its wifi from being used. I therefore obtained an EZCOO 50m USB extender for this, to allow the mobile router to still be connected to the Fritz Box in the house, but located in the garden office. When initially connecting the EE router to my TV PC via the USB extender, I received errors like “The last USB device you connected to this computer has malfunctioned and windows doesn’t recognize it”. Initially This appeared to be cable length related, as if it was a data corruption issue, as it failed on a full run to garden office with generous 7m flex cable at garden end. The full run was likely around the 50m max that was quoted by the EZCOO usb extender. However, this can also be caused by usb driver related issues. I tried to shorten the run by using the shortest cables I could each side of the Cat6 SWA run to the garden office. After this tidying up and retrying, the EE mobile router connected ok.

Significantly, I also received this error when testing the connection with my S22 Ultra mobile, again over the extender. However, when switching to using an older IOCELL Netdisk backup disk via its USB2 connection, it connected fine, which would tend to point more to driver or usb compatibility issues. Crucially, the Netdisk was able to copy significantly sized files both ways successfully over the full distance, indicating that the USB extender was working fine. Also and importantly, connecting the mobile router via the extender to the Fritz Box worked fine – the fritz box did not complain and always connected, but as always generally takes several minutes to switch over correctly between the primary and backup provider.

I continued to try file copying tests over the EE router connected to the TV PC via the extender, and these were all successful including 2-3GB copies to and from a OneDrive share. One issue that muddied the waters a lot was Windows file system caching of data both under Windows and with OneDrive – this led me to think copying had been completed when it hadn’t, or when a cache had been used to avoid the copy. Once I eliminated these issues all the tests were fine.

After retesting again today I had no problems connecting or speed testing, including tests done with the mobile router connected to the Fritz Box. I have had an occasional issue where speed test upload test did not work at all. I think that this may be a general ee mobile contention issue and perhaps if the upload link is too slow, ookla speed test just doesn’t bother and gives up.

DNS Issues

During the last couple of days, DNS has not been an issue with Zen overrides set, or by leaving the provider defaults. DNS still seems like it might be an issue, so it may be necessary to try another free public override on the DNS. The top rated free public servers are generally Cloud, Google, and OpenDNS, and details of these may be found on TechRadar here or on Broadband Genie here.

Points re topup and sim expiry

The terminology and process on this was not entire clear initially:-

• Firstly you need to purchase more credit, using a credit card, via ee.co.uk/topup . This can be done from any internet connection, by entering the mobile router phone number twice to authenticate (you don’t need a password to do this). The number was not listed in the paperwork for the router so I wrote it down on the paperwork for convenience.
• After you top up, i.e. buy credit, you need to visit add-on.ee.co.uk/purchase to get additional data using the credit you just purchased. Note that the word ‘purchase’ in the url here is ambiguous as you have already made a purchase with a credit card – you are just cashing in your credit to buy data. Note that in order to do this stage, your PC must be directly connected to the mobile router, i.e. you cannot be connected via the fritz box, even when it is in backup mode with the mobile router active. You get a choice of sizes, and you must have purchased enough credit previously to cover the size you want.
• In addition, it appears that there is a 6 month sim expiry issue for the PAYG sim used in the mobile router, as per here. You need to not just use the mobile router but also spend money every 6 months (180 days) or the SIM expires and you also lose any credit you had. You can phone EE to recover an expired SIM as detailed here, but if after 273 days you have done nothing, the sim and number expire completely and you will need a new sim and number. Therefore I decided my best option if not needing the backup for extended periods is to use it around twice a year before the 180 days expires, and buy the minimum minutes package (which is £5 at the time of writing).

Comments Off on EE Mobile Router Backup via Fritzbox 7530 – USB Extender and topup issues

We have had this issue a number of times, where the cover keyboard just won’t work, even after rebooting several times.

This appears to be a common problem which is griped about online, and the solutions are varied, not that clear/consistent, and do not always work. I even replaced the cover keyboard, which did fix the problem at the time, but I then later found that the original one still worked!

IMO this looks like some kind of underlying bios problem.

After trying a number of ideas which did not work, including removing the keyboard driver, and disabling/re-enabling the keyboard in the UEFI bios, I found that booting into the UEFI bios (hold +volume button whilst pressing on button), and then rebooting again, seemed to work.

This site here appeared to have some helpful ideas, including running the keyboard troubleshooter, which I had not seen previously. As the troubleshooter initially said that there were no problems (!), I had to run additional troubleshooters and then select keyboard, as per the post, for it to work. In my case, the troubleshooter ran fine, but the keyboard was already working, so I’ll have to wait until next time to see if this helps to solve the problem, should it occur again.

Comments Off on Surface Pro 4 Keyboard not working

I obtained an EE mobile router as backup for the occasions when my main FTTC internet goes down. The main internet went down recently for and extended period due to an OpenReach Fibre connection issue to the exchange.

EE have the best mobile data coverage for my area per the ofcom coverage site here.

Zen internet sent me an EE mobile router as backup during the above outage (I presume they knew that EE had the best coverage in my area).

I was able to readily plug the router into a PC and get mobile coverage.

However, doing this via my Fritzbox 7530 needed some tweaking. The fritzbox has mobile internet backup capability via a submenu on its internet menu. This allows enabling the mobile router (plugged in via its usb port) as a backup only when the main internet is down.

Initially when I tried this having unplugged the main DSL connection, the internet showed as up, but DNS translation did not work. I found that under the internet menu/Account Information/DNS Server settings, I had overridden the DNSV4  servers provided by the ISP with specific Zen ones. Once I returned this setting to “use DNSv4 servers assigned by the internet service provider (recommended)”, DNS then worked on the mobile connection. In addition, automatic failover to mobile worked correctly when I unplugged the DSL connection, although this did take a few minutes to stabilise and was not instant.

In practice, I planned not to leave the mobile router plugged in, but to connect when needed. However, the fact that it is capable of providing shared internet and wifi via the router to my whole network was a real plus.

I found that the EE mobile router performed particularly well from my garden office (which is of wooden construction). I obtained approx 50Mb down and 1 Mb up in this situation – the down link speed was actually better than my FTTC which is around 32Mb. However in the house via the Fritzbox 7530, this reduced to around 20Mb down, presumably due to the brick construction blocking the signal more than the wooden building did.

However, in both of these situations the mobile data rate was way better than I had previously obtained by tethering my Vodafone Mobile – in the latter case, the connection was very slow and intermittent – sometimes I could not get a connection at all, so it would have been no use as a backup for remote working. The EE mobile router was perfectly suited for use as a remote working backup, although I planned not to leave it plugged in permanently as a hot backup but to manually plug in when required, as it was not instant anyway, and in practice I may have to buy additional minutes from EE as they seem to expire if you don’t use them within a set period.

Comments Off on EE Mobile Router Backup via Fritzbox 7530

I had an existing logo which was created in CorelDraw, and exported to Windows Metafile (WMF) format.

This can be imported into office directly. Having done this, if desired, the graphic can be typically ungrouped into its constituent graphic elements via its context menu (right click/group/ungroup). Having done this, you can then tweak the individual elements e.g. change colours/fonts used etc. I tried this in both Word and Powerpoint, and had done this previously in an existing powerpoint presentation.

Details of the WMF format and usage may be found on Wikipedia here.

Comments Off on Editing WMF files in Office – Word/Powerpoint

I was using Spring Data JPA with Oracle as part of an export process from CouchDB to Oracle. The CouchDB export application first exports my existing Places data from CouchDB, then maps it to the entity model I am using for JPA/Oracle, then persists it into Oracle, and finally performs some rudimentary listing of the Oracle data by logging it.

Some issues/points came to light during this excercise which I am noting here:-

1/ My connect string to Oracle was using a Pluggable database in Oracle XE. This needs to use a service name (xepdb1) rather than a SID (xe) for the connection. To do this I needed to use a slash before the service name in the application properties, to indicate a service name, rather than the colon I would normally use for a SID:

# Oracle settings
spring.datasource.url = jdbc:oracle:thin:@localhost:1521/xepdb1
spring.datasource.username = places
spring.datasource.password = xxxxxxxx

2/ I changed the Hibernate naming strategy in the application properties to prevent unwanted snake casing of Oracle column names:

# Hibernate settings
spring.jpa.hibernate.naming.physical-strategy = org.hibernate.boot.model.naming.PhysicalNamingStrategyStandardImpl

3/ For persisting to Oracle, I had the choice of using Spring Data JPA, calling save() or saveAll() on the Individual Repository interfaces that extended CrudRepository (such as PlacesRepository), or I could use the Entity Manager. The Spring Data methods would persist or update fine, and could also save an iterable in one call. However, I had some small additional logic as I was passing and returning a Map. As I chose not to put this logic in the service layer, I therefore used an ordinary JPA Dao (repository) class, and autowired the entity manager via the @PersistenceContext annotation. I could therefore incorporate my logic in a single call and use entityManager.merge() to persist. I felt that situations vary and that it was not always appropriate to use Spring Data Interfaces for some use cases. However the Spring Data find queries were useful and clever for querying the database as they allowed for example a find by key with a like, and order by, just by declaring the appropriate method calls in the interface. I also used the @Query annotation for a custom query, which again was just annotated on a method in the interface.

4/ I had issues whereby the foreign keys on dependant entities were not being auto populated and threw up as null, even when I set nullable=false on the @JoinColumn annotations. In the end it was a simple case of not populating the objects in my model on both sides of the join before persisting – i.e. I was populating a list in a parent object for a one-to-many, but not populating the parent in the dependant object. Doing this resolved the problem and everything persisted automatically with a single parent persist/merge, with hibernate allocating primary keys via Oracle sequences, and then auto populating them in the foreign keys. This stack overflow post here pointed me in the right direction on this. I kept the nullable=false annotations where appropriate to correctly match the relationship I was using, and what was in Oracle.

5/ Once I was at the point of listing everything I had persisted, using Spring Data queries and some simple logging, I was initially hit with Hibernate multiple bag fetch exceptions when listing the data. At this stage I had annotated my repository methods as @Transactional rather than the service layer, and was therefore using explicit eager loading annotations as I needed everything to load before the methods returned. This post here details the issue, and it appears that Hibernate can only eagerly load one collection at a time. My solution to this was to take the more normal route of annotating my service methods as @Transactional rather than the repository, which then allowed a number of repository calls to be made from a single service method, all in the same transaction. Whilst this did expose the service layer to the transaction architecture and javax.transaction package, it is the more normal approach and gives flexibility in the service layer. In my case I could then just revert to the default lazy loading and perform the logging in the same service layer method (which I was happy to do as this was a very basic example just to demonstrate fetching the imported data from Oracle). Everything then worked fine.

Comments Off on Using Spring Data JPA with Oracle

I just installed the latest 21c version of XE, and having created the system user, I connected to this via SQL developer, using XE as the SID. All fine so far.

When I then went to create a new schema via the CREATE USER command, I received ORA-65096: invalid common user or role name. Upon researching this I found that Oracle now uses a hierarchy of pluggable databases or PDBs inside a container database or CDB. Schemas aka users can then sit inside a PDB as normal. Inside the CDB, where I was logged in, the rules are different and common users are required which have their own rules and naming conventions.

I just wanted a simple local develpment solution for JPA use, so did not especially want to learn all the ins and outs of this. I found that an XE installation creates a default PDB called XEPDB1, and managed to create an SQL developer connection to this using the already created system account. I tried using XEPDB1 as the SID rather than XE, but this failed as invalid. However when I tried XEPDB1 as a service name rather than a SID it all worked fine. I did not need to make any other changes to the connection settings – user (system), password, and port (1521) were identical.

Having then connected via this new connection, I was successfully able to create a new schema in the default PDB. As expected, to connect to this new schema I again had to use the service name of XEPDB1 and I was able to connect, once I had granted the CREATE SESSION privilege to the new user after creating it to allow me to log on. I could then proceed to grant the necessary privileges to the user and create/populate tables etc. Initially, in addition to granting CREATE SESSION, I just simply granted UNLIMITED TABLESPACE to allow the schema user to allow tables to be populated. With this I was successfully able to perform inserts, upates, deletes, and selects on all the tables present.

Comments Off on Oracle XE 21c – Container vs Pluggable Databases – CDBs vs PDBs

I had a legacy EA 12 model for the places guide database which I had used as the basis for the CouchDB implementation.

I wanted to explore a relational database as an alternative route, with the aim of not bothering with completely offline access due to the devlopment effort needed, and the lessening need due to improvements in mobile data access in the last few years. Initially I created an Oracle version of the model file, and tweaked the PK and FK  data types from UUID to long and checked a few other things.

I then tried selecting the domain model in the explorer, and using Package/Database Engineering/Generate Package DDL from the toolbar. This brought up the relevant dialogue to do the export, but try as I might it could not find any entities to export as DDL.

I then found this post here, which points out that you need to transform the relevant entities to DDL first to enable this to work. I did this using Package/Model Transformation (MDA)/Transform Current Package. You then select the entities to transform and select DDL on the right under transformations, and then hit Do Transform. This creates a DDL diagram. The original Generate Package DDL option above then worked – I was able to find all the desired entities and transform them. I had to visit each entity to select the target database DDL format, in my case Oracle, or else I got an error, but once this was done, it all worked fine.

I elected to create a single DDL SQL file and did not worry about the entity ordering – you can reorder when doing the DDL generation but I did not bother. The output DDL was pretty good as a starter and was clear. It also appeared to have been created in a way that was order independent – the tables were all created first, followed by all the foreign key contraints, so that all the tables existed prior to creating the constraints, making it order independent.

Some tweaking of the model will be needed, especially in the area of Place Features related tables, and also sequence generation, as I would likely use Oracle sequences for PK generation, via JPA/Hibernate. However, I had reached a good trial starting point which avoided the need to create all the DDL manually from scratch.

Comments Off on Exporting and Enterprise Architect 12 model as SQL/DDL statements

Having got CouchDB working under Windows 11 with the legacy places data as per this post here, I then wanted to run the legacy places angular and ionic apps if possible, just for reference and to consider my options going forward.

The angular app was in v6.1.7 which I did not want to revisit and upgrade. Similarly, the ionic app was an earlier legacy version which could be tricky to reinstate under windows 11.

However, I did have already built distributions for both apps, and both were able to run successfully under Windows 11 via http-server without having to install anything else. For angular I used the existing build under the dist subdirectory, and for Ionic I the build is under the www subdirectory. Note that whilst the index.html for the Ionic version did specify that cordova.js was required, and caused a load error in the web console, this was not an issue when using from a browser as it was not needed.

I did want to be able to run them remotely as well, from other PCs and mobiles. I tried installing the distributions under Zen hosting, with remote access to CouchDB running on the local PC. However, this would not run under HTTPS as it meant having mixed content – the access to CouchDB was not HTTPS and I did not want to go to the trouble of installing a self signed cert locally to get it all to work – this excercise was not worth the effort. I could not find an easy way under Zen cpanel of allowing just this app to be HTTP only, with everything else defaulting to HTTPS. If I turned off forced defaulting to HTTPS in cpanel, the app worked fine under HTTP but other access was also allowed to be HTTP only which I did not like, so I dumped the idea of hosting under Zen directly. I did hit a spate of nasty looking cpanel issues when I did this and for a while thought I had broken the domain/ssl/cpanel access entirely whilst messing with domain/alias/redirect settings in cpanel, but in the end it all worked fine again.

I therefore continued to run/host locally via http-server. I did want to be able to potentially remote boot my local PC via Fritz and access the app from anywhere, which would mean auto running the http-servers at boot time. The easiest way to do this turned out to be to use the windows task scheduler, which unlike services can run batch files without any other tools such as srvany which is commonly used to do this for services. Whilst the scheduler is often used with time based triggers, it is perfectly possible to specify a trigger as ‘run at boot time’. I also specified that it should run without any user logged in, therefore with local access only/no user authentication. This worked fine and I could boot the PC and then immediately access the places apps from a mobile without logging in.

Another trick needed was to add some remote port sharing in the Fritz box for both apps, via my static IP addresses. When doing this I also had to add a port share for the CouchDB access, otherwise CouchDB also complained about mixing private CORS stuff with the remote access. Once I did this, and changed the app config to use the remote URL for CouchDB access, it all worked fine. Fortunately, I could also continue to access the same apps locally on the hosting PC even though they were still using the remote URL for CouchDB access – it all worked fine.

I then set up redirects under cpanel from Zen to make the app access look a bit more friendly with salient soft urls, and this all ran fine.

Comments Off on Running Legacy Places Guide under Windows 11 for reference

Update 9/5/23

I reinstalled the current latest version, V3.3.2, to try to solve an issue where I could not connect to Fauxton (In fact this was my mistake – I was effectively using 127.0.0.1:5984 rather than the actual IP address i.e. nodename:5984, having forgotton I had changed the binding in local.ini).

After reinstalling, I edited local.ini and used my previous trick below to add a plaintext password and let couchDB encode it. However, couchDB seemed to ignore anything I placed in local.ini, and instead was using a file etc\local.d\10-admins.ini. When I editied this latter file, I could add the password correctly and it was honored (then encoded by CouchDB and replaced in the file).

When reinstalling, I had simply uninstalled the old version via control panel, then installed the new one on top without removing any other existing files (in particular I left the existing database in place). It appears that the installer took my old custom settings and placed them in the above 10-admins.ini file.

I have left this as it is at present but may change this later. This page here gives a good intro to the configuration files, their precedence order and how to override stuff. This section on authentication mentions the 10-admins.ini file which it says is present if you intall from a package like I did.

Original Post

I had a zip backup of a complete old version with data, but needed to locate the old release to reinstall on a new PC and reinstate the data

MSIs of old releases can be found in the apache archive here 

If you look under the releases subfolder in the old installation there is a RELEASES text file which details the release information. Mine was release 2.0.0.

The latest release at the time of posting is 3.2.2, but I was not clear that the data structures would be forwards compatible if I just restored all the previous data I had (this is one way that backup is proposed, as opposed to replicating to another server which I didn’t want to do).

On issue was that I had temporarily forgotten the admin password. This post here details how to change an admin password manually if you forget – you can just change the hashed password against an admin user with a plaintext one, and CouchDB will detect this and swap it for the hashed version when it is next restarted.

After installing v2.0.0, it would not fully start on Windows 11 – the service paused during startup. It did however run on an older Windows 10 pc, and also ran correctly when I restored all the data.

I then tried the latest 3.2.2 version on the Windows 11 pc, and again restored the data. I had a couple of issues – one was an incorrect server name in the app config url which prevented access to the database. A second issue peculiar to V3.2.2 was that initially I got errors when trying to access the database from the app with no authentication (this simple legacy Proof of Concept was not authenticated). I then found in the user settings in V3 that by default there were admin roles specified which were preventing simple access with no authentication. Once I removed these, this solved the problem and access from the application worked correctly without authentication.

This then worked fine – there were no compatibility issues with V2.0.0 data when restored under v3.2.2.

Comments Off on Reinstalling Apache CouchDB

I had some of these image files from some legacy clip art photos from an older version of Corel Draw.

Ideally I wanted to be able to preview them in windows explorer, as happens automatically with JPG files, however this would not work. I tried IrfanView, which is a separate image viewer, but this failed to view the files, as it could not locate jpeg2000.dll. I tried to locate and install the dll online, but was unable to prevent the error, so IrfanView would not work.

I tried another package, the FastStone Image Viewer, and this worked successfully. You can select folders in the left column in an explorer like fashion, and the jp2 images are shown as large icons on the right. Whilst I still could not preview them in explorer, FastStone worked perfectly well in being able to preview these legacy images. It can also view a number of other graphics formats such as WMF which I had used previously for the company logo.

An install kit for FastStone can be downloaded here.

Comments Off on Viewing JP2 image files in Windows 11