alcatel omniswitch backup issue

Unimus support forum
Post Reply
jeremy
Posts: 3
Joined: Sun Apr 04, 2021 5:25 am

Sun Apr 04, 2021 5:31 am

Hello,
We give a try to backup alcatel omniswitch and we saw that ftp should be enable so that the backup work. Ftp is not safe at all in network. Is there any other possibility to backup omniswitch ? For example over SSH and TFTP file sent back.

The other point is that the automated backup did not pass with a "connection_error". If we just make a manual "Backup now" this is working.
User avatar
Tomas
Posts: 1206
Joined: Sat Jun 25, 2016 12:33 pm

Sun Apr 04, 2021 2:43 pm

Hello,

Unimus doesn't use FTP / TFTP - only CLI (SSH / Telnet). You can check "Other settings > Connector settings" to view which connectors are used, and on what ports. By default Unimus uses only SSH.

AlcaLu OmniSwitches should already be fully supported over the CLI.
jeremy wrote:
Sun Apr 04, 2021 5:31 am
The other point is that the automated backup did not pass with a "connection_error". If we just make a manual "Backup now" this is working.
Can you please check the log file, and paste the logs for the job that failed?
jeremy
Posts: 3
Joined: Sun Apr 04, 2021 5:25 am

Mon Apr 05, 2021 6:53 am

Hello,

Here the log detail. The manual backup is working fine when pushing "backup now" but the overnight 3am backup fail with reporting fail status and red in last job status.

2021-04-03 21:20:14.624 INFO 8180 --- [main] n.unimus.starter.composite.Application : Starting Application v2.0.13 on DESKTOP-NG27PUH with PID 8180 (C:\Program Files\Unimus\Unimus.exe started by DESKTOP-NG27PUH$ in C:\Program Files\Unimus)
2021-04-03 21:20:14.843 INFO 8180 --- [main] n.unimus.starter.composite.Application : The following profiles are active: jar,composite,unimus,core,win,unimus-win
2021-04-03 21:21:10.171 INFO 8180 --- [main] s.b.c.e.t.TomcatEmbeddedServletContainer : Tomcat initialized with port(s): 8085 (http)
2021-04-03 21:22:38.677 WARN 8180 --- [localhost-startStop-1] net.unimus.business.fqdn.FqdnResolver : Error looking up system FQDN. Lookup process exited with exit code '2'
2021-04-03 21:22:38.686 INFO 8180 --- [localhost-startStop-1] net.unimus.business.fqdn.FqdnResolver : Falling back to FQDN lookup through localhost due to previous error
2021-04-03 21:23:04.176 INFO 8180 --- [main] s.b.c.e.t.TomcatEmbeddedServletContainer : Tomcat started on port(s): 8085 (http)
2021-04-03 21:23:04.199 INFO 8180 --- [main] n.unimus.starter.composite.Application : Started Application in 177.06 seconds (JVM running for 181.251)
2021-04-03 21:23:04.699 INFO 8180 --- [SimpleAsyncTaskExecutor-1] n.u.s.b.b.step.LoggingPathAccessibility : Checking logging subsystem
2021-04-03 21:23:04.715 INFO 8180 --- [SimpleAsyncTaskExecutor-1] n.u.s.b.b.step.DatabaseConfigValidation : Config file not found, wizard is required, bootstrap finished
2021-04-03 21:28:21.846 INFO 8180 --- [SimpleAsyncTaskExecutor-2] n.u.s.b.w.step.ValidatingLicenseKey : Validating license key
2021-04-03 21:28:25.331 INFO 8180 --- [SimpleAsyncTaskExecutor-2] n.u.b.file.DefaultUnimusConfigFile : Saving license key
2021-04-03 21:28:25.369 INFO 8180 --- [SimpleAsyncTaskExecutor-2] n.u.s.b.w.step.DatabaseConnectionCheck : Testing database connection
2021-04-03 21:28:25.926 INFO 8180 --- [SimpleAsyncTaskExecutor-2] n.u.s.b.w.step.DatabaseConnectionCheck : Database connection test passed
2021-04-03 21:28:26.040 INFO 8180 --- [SimpleAsyncTaskExecutor-2] n.u.s.b.wizard.step.DatabaseUpdate : Connecting and creating / updating database tables (HSQL)
2021-04-03 21:28:47.688 INFO 8180 --- [SimpleAsyncTaskExecutor-2] net.unimus.business.database.Database : Executing CHECKPOINT command for HSQL database.
2021-04-03 21:28:47.804 INFO 8180 --- [SimpleAsyncTaskExecutor-2] n.u.s.b.w.step.SavingDatabaseConfig : Saving database configuration into properties file
2021-04-03 21:28:47.826 INFO 8180 --- [SimpleAsyncTaskExecutor-2] n.u.s.b.w.step.SettingEncryptionKey : Configuring cryptor with database encryption key
2021-04-03 21:28:48.338 INFO 8180 --- [SimpleAsyncTaskExecutor-2] n.u.s.b.w.step.PopulatingDefaultData : No data found. Populating database with default data
2021-04-03 21:28:49.431 INFO 8180 --- [SimpleAsyncTaskExecutor-2] n.u.s.b.w.step.InternalInitialization : Internal initialization completed
2021-04-03 21:28:49.438 INFO 8180 --- [SimpleAsyncTaskExecutor-2] n.u.s.b.wizard.step.WizardMigrationStep : Running version migration
2021-04-03 21:28:49.563 INFO 8180 --- [SimpleAsyncTaskExecutor-2] n.u.s.b.wizard.step.WizardMigrationStep : Version migration completed
2021-04-03 21:28:49.616 INFO 8180 --- [SimpleAsyncTaskExecutor-2] n.u.s.b.w.step.WizardTcpServerStart : Initializing Core connection server
2021-04-03 21:28:49.694 INFO 8180 --- [SimpleAsyncTaskExecutor-2] n.unimus.business.core.OpManagementImpl : Starting Core connection server on port '5509'
2021-04-03 21:28:50.325 INFO 8180 --- [task-scheduler-5] net.unimus.business.aaa.AAAHandlerImpl : User 'jbriod' logged in from '127.0.0.1'.
2021-04-03 21:28:50.531 INFO 8180 --- [pool-2-thread-1] n.u.b.sync.license.LicenseSyncerImpl : License sync started
2021-04-03 21:28:50.717 INFO 8180 --- [pool-2-thread-1] n.u.b.sync.license.LicenseSyncerImpl : License sync finished
2021-04-03 21:28:50.736 INFO 8180 --- [pool-2-thread-1] net.unimus.system.state.states.OkState : Unimus is ready; enjoy the application :)
2021-04-03 21:28:50.762 INFO 8180 --- [core-request-delivery-1] n.u.c.a.h.UpdateLogLevelRequestHandler : Updating logging level to 'INFO'
2021-04-03 21:28:51.809 INFO 8180 --- [core-request-delivery-2] .h.ThreadPoolConfigurationRequestHandler : Configuring thread pool(s) to 'ThreadPoolConfigurationRequest(opId=d8a88d62-f3d6-4268-ba1a-27652ddf8d7d, zoneId=Z-096b8ee7-52ce-4d6f-9f2c-47cb1d60b62a, discoveryThreadPoolConfig=ThreadPoolConfig(coreSize=100, maxSize=100, keepAliveSecs=60), backupThreadPoolConfig=ThreadPoolConfig(coreSize=100, maxSize=100, keepAliveSecs=60), pushThreadPoolConfig=ThreadPoolConfig(coreSize=100, maxSize=100, keepAliveSecs=60), scanThreadPoolConfig=ThreadPoolConfig(coreSize=20, maxSize=20, keepAliveSecs=60))'
2021-04-03 21:28:51.923 INFO 8180 --- [core-rsp-handler-1] .u.b.c.s.h.UpdateLogLevelResponseHandler : Core logging level has been set to 'INFO' for zone with number '0'
2021-04-03 21:31:02.514 INFO 8180 --- [http-nio-8085-exec-5] n.u.s.p.v.i.VaadinSettingsServiceImpl : User 'jbriod' saving 'SystemSettings(preferIpv6=false, discoverWhenAdded=true, discoverUnDiscoveredWhenConnectorChange=true, reDiscoverAffectedWhenConnectorChange=true, reDiscoverAffectedWhenCredentialsRemoved=true, discoverUnDiscoveredWhenCredentialsAdded=true, discoverUnDiscoveredOnStart=true, discoverOnAddressChange=true, backupWhenAdded=false, backupAllOnStart=false, importedDeviceDescriptionUpdatePolicy=IF_EMPTY, stripSensitiveDataPolicy=NEVER_STRIP_DATA, deviceCredentialsSecured=false)'
2021-04-03 21:33:59.857 INFO 8180 --- [http-nio-8085-exec-4] n.u.s.p.v.impl.VaadinDeviceServiceImpl : User 'jbriod' creating new 'Device{id='null', creationTime='null', uuid='null', remote-uuid='null', address='10.18.22.28', deviceState='NONE', description='sw-bsa-chex-01', vendor=Unknown', type=Unknown', model='null', zone='Zone{id=0, createTime=1617478130, uuid='Z-096b8ee7-52ce-4d6f-9f2c-47cb1d60b62a', number='0', name='Default', isDefault=true, description='null', proxyType=EMBEDDED, accessKey='null', coreId='null', coreIpAddress='null', collectDeviceOutput=false, logLevel=INFO}'}'
2021-04-03 21:33:59.860 INFO 8180 --- [http-nio-8085-exec-4] n.u.s.p.impl.PrivateDeviceServiceImpl : Adding new device '10.18.22.28'
2021-04-03 21:34:00.231 INFO 8180 --- [http-nio-8085-exec-4] n.u.s.p.impl.PrivateDeviceServiceImpl : Setting owner 'SystemAccount{id='0', createdTime='1617478129', role='ADMINISTRATOR', authentication type='Local', username='jbriod', password 11 characters}'
2021-04-03 21:34:00.260 INFO 8180 --- [http-nio-8085-exec-4] net.unimus.business.scheduler.Scheduler : Scheduling 'discovery / backup' job 'At 3:00 AM, every day'
2021-04-03 21:35:08.869 INFO 8180 --- [SimpleAsyncTaskExecutor-6] n.u.s.p.v.impl.VaadinDeviceServiceImpl : User 'jbriod' requesting backup operation with '1' device(s)
2021-04-03 21:40:25.474 INFO 8180 --- [SimpleAsyncTaskExecutor-7] n.u.s.p.v.impl.VaadinDeviceServiceImpl : User 'jbriod' requesting backup operation with '1' device(s)
2021-04-03 21:41:21.212 INFO 8180 --- [http-nio-8085-exec-4] n.u.s.p.v.impl.VaadinBackupServiceImpl : User 'jbriod' counting backup(s) using command 'BackupCountCommand(account=SystemAccount{id='0', createdTime='1617478129', role='ADMINISTRATOR', authentication type='Local', username='jbriod', password 11 characters}, deviceReduction=DeviceReduction(deviceIds=[0]))
2021-04-03 21:41:21.325 INFO 8180 --- [http-nio-8085-exec-4] n.u.s.p.v.impl.VaadinBackupServiceImpl : User 'jbriod' getting backup(s) using command 'BackupGetCommand(account=SystemAccount{id='0', createdTime='1617478129', role='ADMINISTRATOR', authentication type='Local', username='jbriod', password 11 characters}, entityDescriptor=net.unimus.service.priv.impl.device.backup.get.domain.model.BackupEntityDescriptor@a457e72, deviceReduction=DeviceReduction(deviceIds=[0]), backupReduction=BackupReduction(backupIds=[]), pageable=Optional[Page request [number: 0, size 1000, sort: createTime: DESC]])
2021-04-03 21:41:25.397 INFO 8180 --- [http-nio-8085-exec-7] n.u.s.p.v.impl.VaadinBackupServiceImpl : User 'jbriod' getting backup(s) using command 'BackupGetCommand(account=SystemAccount{id='0', createdTime='1617478129', role='ADMINISTRATOR', authentication type='Local', username='jbriod', password 11 characters}, entityDescriptor=net.unimus.service.priv.impl.device.backup.get.domain.model.BackupEntityDescriptor@29c75a8b, deviceReduction=DeviceReduction(deviceIds=[]), backupReduction=BackupReduction(backupIds=[0]), pageable=Optional.empty)
2021-04-03 21:42:56.932 INFO 8180 --- [http-nio-8085-exec-5] n.u.s.p.v.i.VaadinNetworkScanServiceImpl : User 'jbriod' creating new 'ScanPreset{id='null', createTime='null, name='nms', description='null', addDiscoveredDevices='false', subnets='[10.18.22.0/24]', lastScanTimestamp='null'}'
2021-04-03 21:42:56.966 INFO 8180 --- [http-nio-8085-exec-5] n.u.s.p.i.PrivateNetworkScanServiceImpl : [createScanPreset] Network scan preset created. ScanPreset{id='0', createTime='1617478976, name='nms', description='null', addDiscoveredDevices='false', subnets='[10.18.22.0/24]', lastScanTimestamp='null'}. UnimusUser{tabId='ROOT-2521314-0.4335227716735105.ROOT-2521314', sessionId='90df4afc-bdba-4acf-adb1-1fb0560b08b3', browser='Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:87.0) Gecko/20100101 Firefox/87.0', userOrigin='IpAddresses{requestFrom='127.0.0.1', requestProxiedFor=[]}', account='jbriod'}
2021-04-03 21:43:13.420 INFO 8180 --- [SimpleAsyncTaskExecutor-8] n.u.s.p.v.i.VaadinNetworkScanServiceImpl : User 'jbriod' trigger network scan operation with 'ScanPreset{id='0', createTime='1617478976, name='nms', description='null', addDiscoveredDevices='false', subnets='[10.18.22.0/24]', lastScanTimestamp='null'}'
2021-04-03 22:17:27.409 INFO 8180 --- [http-nio-8085-exec-8] net.unimus.business.aaa.AAAHandlerImpl : User 'jbriod' logged out.
2021-04-04 03:00:00.096 INFO 8180 --- [qrtz--8] n.u.b.core.quartz.DiscoveryBackupJob : Looking for devices to discover/backup
2021-04-04 07:15:33.462 INFO 8180 --- [http-nio-8085-exec-1] net.unimus.business.aaa.AAAHandlerImpl : User 'jbriod' logged in from '127.0.0.1'.
2021-04-04 07:15:59.492 INFO 8180 --- [SimpleAsyncTaskExecutor-9] n.u.s.p.v.impl.VaadinDeviceServiceImpl : User 'jbriod' requesting backup operation with '1' device(s)
2021-04-04 08:01:23.637 INFO 8180 --- [http-nio-8085-exec-8] net.unimus.business.aaa.AAAHandlerImpl : User 'jbriod' logged out.
2021-04-05 03:00:00.139 INFO 8180 --- [qrtz--1] n.u.b.core.quartz.DiscoveryBackupJob : Looking for devices to discover/backup
2021-04-05 08:23:11.166 INFO 8180 --- [http-nio-8085-exec-9] net.unimus.business.aaa.AAAHandlerImpl : User 'jbriod' logged in from '127.0.0.1'.
2021-04-05 08:29:58.285 INFO 8180 --- [SimpleAsyncTaskExecutor-10] n.u.s.p.v.impl.VaadinDeviceServiceImpl : User 'jbriod' requesting backup operation with '1' device(s)
User avatar
Tomas
Posts: 1206
Joined: Sat Jun 25, 2016 12:33 pm

Mon Apr 05, 2021 2:16 pm

Any chance you have some throttling / login rate limiting, or some other security that would block multiple concurrent logins to the device?

The only different between a manual backup and a scheduled backup is that during a scheduled job, first a discovery and then a backup are ran - so it's not just backup, it's discovery and backup. This can cause multiple logins to the device (depending on settings, 3 logins in a few seconds). We often see security / ACL / login rate limits causing issues like you describe.

Alternatively, could you adjust the "inter-connection-delay" to 1000 as per this article:
https://wiki.unimus.net/display/UNPUB/C ... t+timeouts

If none of those help - could you please enable "Device output logging" AND "Debug logging" under "Zones > your_zone > Debug mode", let the scheduled job run and fail, and create a Support Ticket on our Portal with both the log files?

Thanks!
jeremy
Posts: 3
Joined: Sun Apr 04, 2021 5:25 am

Mon Apr 05, 2021 4:00 pm

Hi Toma,

Thank you for this information. here the log output of alcatel omniswitch. This is exactly that point. The maximum ssh session is reach.
Seems that this number can not be change on series omniswitch 6850.

We will give a try with the "inter-connection-delay" parameter and give you feedback.


MON APR 05 03:00:01 2021 SSH info Session 24 New SSH Connection from 10.18.22.251 port 27812
MON APR 05 03:00:01 2021 SSH error [SSH 24] sshd_exchange_identification: no bytes available
MON APR 05 03:00:02 2021 SSH info Session 25 New SSH Connection from 10.18.22.251 port 27812
MON APR 05 03:00:02 2021 SESSION info [SES] Authentication failed: Session 25, access type Ssh
MON APR 05 03:00:02 2021 SESSION info [SES] Session 25, user "admin"
MON APR 05 03:00:02 2021 SESSION info [SES] Session 25, IP address 10.18.22.251
MON APR 05 03:00:03 2021 SSH info Session 24, Session Deleted
MON APR 05 03:00:04 2021 SSH info Session 26 New SSH Connection from 10.18.22.251 port 27812
MON APR 05 03:00:04 2021 SESSION info [SES] Authentication failed: Session 26, access type Ssh
MON APR 05 03:00:04 2021 SESSION info [SES] Session 26, user "admin"
MON APR 05 03:00:04 2021 SESSION info [SES] Session 26, IP address 10.18.22.251
MON APR 05 03:00:05 2021 SSH info Session 25, Session Deleted
MON APR 05 03:00:07 2021 SSH info No more SSH session available in this minute
MON APR 05 03:00:07 2021 SSH info Maximum session:3,Established:4
MON APR 05 03:00:07 2021 SSH warning [SSH 0] No more SSH session available in this minute
MON APR 05 03:00:07 2021 SSH warning [SSH 0] Maximum session:3,Established:4
MON APR 05 03:00:08 2021 SSH info Session 26, Session Deleted
User avatar
Tomas
Posts: 1206
Joined: Sat Jun 25, 2016 12:33 pm

Mon Apr 05, 2021 5:57 pm

jeremy wrote:
Mon Apr 05, 2021 4:00 pm
This is exactly that point. The maximum ssh session is reach. Seems that this number can not be change on series omniswitch 6850.
I would also recommend using credential binding instead of discovery - that should help too.
Devices > Edit > Bind credentials > select correct credential > Save

This will cause Unimus to only connect with the specified credentials instead of running discovery using all credentials - which should cut down on the number of SSH sessions being opened to the device.
Post Reply